-- Logs begin at Tue 2022-01-18 15:48:24 UTC, end at Tue 2022-01-18 16:48:49 UTC. -- Jan 18 16:21:31.574331 dv-cinder-788368-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 18 16:21:31.582188 dv-cinder-788368-3-iscsi devstack@n-api.service[101724]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 18 16:21:31.584162 dv-cinder-788368-3-iscsi devstack@n-api.service[101724]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jan 18 16:21:31 2022] *** Jan 18 16:21:31.584162 dv-cinder-788368-3-iscsi devstack@n-api.service[101724]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 18 16:21:31.584162 dv-cinder-788368-3-iscsi devstack@n-api.service[101724]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 18 16:21:31.584162 dv-cinder-788368-3-iscsi devstack@n-api.service[101724]: nodename: dv-cinder-788368-3-iscsi Jan 18 16:21:31.584162 dv-cinder-788368-3-iscsi devstack@n-api.service[101724]: machine: x86_64 Jan 18 16:21:31.584162 dv-cinder-788368-3-iscsi devstack@n-api.service[101724]: clock source: unix Jan 18 16:21:31.584162 dv-cinder-788368-3-iscsi devstack@n-api.service[101724]: pcre jit disabled Jan 18 16:21:31.584162 dv-cinder-788368-3-iscsi devstack@n-api.service[101724]: detected number of CPU cores: 4 Jan 18 16:21:31.584735 dv-cinder-788368-3-iscsi devstack@n-api.service[101724]: current working directory: / Jan 18 16:21:31.584735 dv-cinder-788368-3-iscsi devstack@n-api.service[101724]: detected binary path: /usr/bin/uwsgi-core Jan 18 16:21:31.584735 dv-cinder-788368-3-iscsi devstack@n-api.service[101724]: your processes number limit is 47680 Jan 18 16:21:31.584735 dv-cinder-788368-3-iscsi devstack@n-api.service[101724]: your memory page size is 4096 bytes Jan 18 16:21:31.584735 dv-cinder-788368-3-iscsi devstack@n-api.service[101724]: detected max file descriptor number: 2048 Jan 18 16:21:31.584735 dv-cinder-788368-3-iscsi devstack@n-api.service[101724]: lock engine: pthread robust mutexes Jan 18 16:21:31.584735 dv-cinder-788368-3-iscsi devstack@n-api.service[101724]: thunder lock: enabled Jan 18 16:21:31.584735 dv-cinder-788368-3-iscsi devstack@n-api.service[101724]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 18 16:21:31.584735 dv-cinder-788368-3-iscsi devstack@n-api.service[101724]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 18 16:21:31.630897 dv-cinder-788368-3-iscsi devstack@n-api.service[101724]: Python main interpreter initialized at 0x562cf17fb9c0 Jan 18 16:21:31.630897 dv-cinder-788368-3-iscsi devstack@n-api.service[101724]: python threads support enabled Jan 18 16:21:31.630897 dv-cinder-788368-3-iscsi devstack@n-api.service[101724]: your server socket listen backlog is limited to 100 connections Jan 18 16:21:31.630897 dv-cinder-788368-3-iscsi devstack@n-api.service[101724]: your mercy for graceful operations on workers is 90 seconds Jan 18 16:21:31.631238 dv-cinder-788368-3-iscsi devstack@n-api.service[101724]: mapped 403077 bytes (393 KB) for 2 cores Jan 18 16:21:31.631343 dv-cinder-788368-3-iscsi devstack@n-api.service[101724]: *** Operational MODE: preforking *** Jan 18 16:21:31.631600 dv-cinder-788368-3-iscsi devstack@n-api.service[101724]: *** uWSGI is running in multiple interpreter mode *** Jan 18 16:21:31.631600 dv-cinder-788368-3-iscsi devstack@n-api.service[101724]: spawned uWSGI master process (pid: 101724) Jan 18 16:21:31.631808 dv-cinder-788368-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 18 16:21:31.632717 dv-cinder-788368-3-iscsi devstack@n-api.service[101724]: spawned uWSGI worker 1 (pid: 101725, cores: 1) Jan 18 16:21:31.632825 dv-cinder-788368-3-iscsi devstack@n-api.service[101724]: spawned uWSGI worker 2 (pid: 101726, cores: 1) Jan 18 16:21:31.634270 dv-cinder-788368-3-iscsi devstack@n-api.service[101724]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 18 16:21:33.410916 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 18 16:21:33.410916 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: from cryptography.utils import int_from_bytes Jan 18 16:21:33.411603 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 18 16:21:33.411603 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: from cryptography.utils import int_from_bytes Jan 18 16:21:33.425079 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 18 16:21:33.425079 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: from cryptography.utils import int_from_bytes Jan 18 16:21:33.425595 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 18 16:21:33.425595 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: from cryptography.utils import int_from_bytes Jan 18 16:21:36.019066 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 18 16:21:36.019608 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 18 16:21:36.019804 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 18 16:21:36.020170 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 18 16:21:36.020428 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 18 16:21:36.020823 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.021182 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.021508 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.021831 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.022171 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.022471 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 18 16:21:36.022853 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.022945 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 18 16:21:36.023031 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.023109 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.023215 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 18 16:21:36.023417 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.023576 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 18 16:21:36.023668 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.023832 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 18 16:21:36.023981 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.024213 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.024309 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-788368-3-iscsi {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.024539 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.024623 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.024860 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.024974 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.025208 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.025309 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.025534 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.025619 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.025844 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.025923 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.026161 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.026247 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.026470 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.026559 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.026796 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.026964 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.027073 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.028073 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.028204 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.028460 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-788368-3-iscsi {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.029088 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.029177 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.029306 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.029394 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.029471 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.029471 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.029740 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.029855 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.029940 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.030017 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.030149 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.030230 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.030417 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.030510 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.030743 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.030879 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.031162 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-788368-3-iscsi {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.031273 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.031489 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.031583 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.031809 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.031891 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.032135 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.032234 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.032464 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.032559 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.032781 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.032866 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.033134 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.033223 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.033455 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.033541 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.033765 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.033857 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.034090 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.034184 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.034399 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.034484 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.034731 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.034828 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-788368-3-iscsi {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.035053 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.035147 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.035380 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.035471 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.035691 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.035783 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.036006 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.036116 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.036321 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.036415 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.036645 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.036730 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.036974 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.037077 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.037289 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.037377 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.037544 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.037629 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.037856 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.037949 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.038182 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.038268 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.038509 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.038600 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.038834 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.038930 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.039092 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.039187 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.039344 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.039443 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.039665 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.039751 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.039991 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.040077 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.040305 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.040400 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.040608 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.040692 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.040860 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.040972 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.041206 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.041304 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.041530 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.041616 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.041835 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.041920 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.042146 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.042241 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.042396 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.042481 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.042648 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.042766 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.042970 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.043082 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.043290 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.043406 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.043598 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.043716 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.043929 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.044064 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.044452 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.044572 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.82 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.044708 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.82 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.044802 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.045046 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.045136 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.045392 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.045485 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.045703 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.045796 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.046012 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.046098 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.046332 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.046428 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.046645 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.046747 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.046952 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.047044 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.047261 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.047397 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.047568 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.047661 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.047891 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.047983 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.82 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.048201 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.82 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.048292 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.048510 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.048597 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.048763 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.048913 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.049084 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.049171 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.049394 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.049482 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.049717 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.049803 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.050027 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.050119 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.050337 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.050426 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.050646 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.050733 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.050950 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.051072 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.051266 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.051360 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.051574 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.051659 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.051883 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.051976 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.052130 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.052216 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.052489 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.052703 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.052788 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.053047 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.053149 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.053372 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.053459 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.053682 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.053773 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.053991 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.054085 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.054301 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.054393 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.054603 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.054700 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.054911 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.054997 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.055216 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.055306 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.055519 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.055603 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.055825 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.055919 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.056132 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.056217 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.056437 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.056534 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.056742 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.056829 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.057077 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.057206 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.057384 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.057483 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.057704 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.057800 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.058020 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.058114 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.058325 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.058428 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.058632 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.058737 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.058935 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.059035 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.059239 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.059342 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.059610 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.059770 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.060004 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.060156 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.060320 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.060609 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.060698 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.060948 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.061049 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.061266 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.061364 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.061574 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.061667 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.061879 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.061971 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.062191 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.062277 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.062497 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.062590 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.062816 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.062906 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.063116 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.063201 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.063423 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.063510 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.063731 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.063815 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.064037 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.064131 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.064344 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.064430 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.064646 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.064738 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.064970 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.065081 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.065278 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.065365 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.065583 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.065668 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.065886 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.065982 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.066192 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.066311 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.066498 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.066639 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.066812 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.066957 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.067133 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.067279 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.067440 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.067611 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.067747 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.067927 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.068052 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.068240 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.068372 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:21:36.068554 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.068706 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.068877 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.069339 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.069491 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.069684 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.069827 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.070000 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.070148 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.070330 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.070467 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.070661 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.070788 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.070978 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.071109 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.071311 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.071416 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.071608 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.071748 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.071933 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.072072 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.072244 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.072387 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.072554 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.072732 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.072870 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.073125 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.073259 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.073454 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.073577 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.073787 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.073906 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.074106 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.074222 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.074431 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.074537 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.074750 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.074843 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.075067 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.075682 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.075974 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.076165 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.076472 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.076637 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.076815 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.076988 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.077161 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.077308 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.077503 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.077655 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.077827 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.078000 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.078149 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.078318 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.078461 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.078646 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.078772 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.078959 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.079082 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.079283 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.079397 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.079598 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.079710 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.079914 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.080034 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.080229 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.080364 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.080560 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.080678 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.080876 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.081045 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.081226 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.081374 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.081566 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.081659 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.081883 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.081976 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.082201 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.082292 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.082509 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.082594 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.082821 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.082919 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.083130 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.083214 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.083442 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.083532 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.083747 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.083841 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.084066 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.084158 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.084391 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.084475 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.084698 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.084859 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.085032 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.085120 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.085352 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.085459 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.085665 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.085752 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.085972 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.086065 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.086279 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.086364 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.086592 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.086726 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.086903 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.086992 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.087211 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.087305 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.087534 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.087621 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.087844 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.087931 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.088150 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.088248 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.088474 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.088559 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.088780 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.088863 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.089116 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.089219 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.089427 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.089511 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.089736 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.089821 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.090042 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.090134 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.090351 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.090436 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.090661 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.090746 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.091698 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.091811 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.092020 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.092268 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.092359 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.092613 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.092698 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.092942 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.093031 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.093262 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.093356 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.093591 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.093685 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.093906 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.093992 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.094218 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.094305 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.094524 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.094616 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.094828 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.094920 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.095130 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.095224 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.095437 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.095535 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.095744 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.095836 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.096053 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.096138 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.096358 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.096456 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.096664 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.096748 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.096991 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.097082 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.097301 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.097388 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.097607 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.097698 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.097930 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.098014 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.098239 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.098332 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.098543 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.098635 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.098848 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.098932 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.099152 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.099238 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.099494 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.099577 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.099802 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.099885 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.100128 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.100214 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.100444 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.100535 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.100768 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.100862 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.101117 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.101357 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.101441 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.101736 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.101945 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.102045 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.102349 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.102433 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.102661 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.102746 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.102981 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.103074 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.103302 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.103387 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.103614 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.103698 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.103930 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.104027 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.104240 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.104325 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.104553 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.104636 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.104862 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.104979 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.105203 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.105295 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.105508 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.105593 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.105823 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.105909 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.106143 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.106226 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.106489 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.106626 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.106811 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.107065 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.107161 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.107490 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.107584 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.107809 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.107950 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.108129 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.108214 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.108443 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.108535 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.108760 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.108853 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.109101 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.109189 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.109417 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.109502 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.109738 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.109877 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.110052 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.110181 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.110370 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.110498 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.110676 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.110805 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.110988 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.111115 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.111298 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.111433 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.111616 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.111792 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.111922 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.112050 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.112222 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.112357 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.112545 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.112673 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.112856 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.113009 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.113202 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.113352 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.113513 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.113641 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.113820 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.113947 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.114130 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.114268 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.114438 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.114567 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.114748 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.114877 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.115053 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.115261 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.115409 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.115546 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.115674 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.115802 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.115952 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.116089 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.116261 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.116390 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.116570 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.116698 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.116877 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.117089 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.117282 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.117425 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.117568 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.117701 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.117843 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.117977 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.118115 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.118248 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.118381 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.118512 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.118701 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.118831 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.119013 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.119159 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.119333 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.119462 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.119648 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.119778 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.119951 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.120093 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.120260 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.120388 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.120570 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.120698 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.120877 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.121026 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.121210 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.121348 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.121517 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.121646 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.121823 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.121967 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.122208 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.122434 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.122585 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.122905 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.122989 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.123237 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.123323 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.123552 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.123638 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.123867 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.123951 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.124180 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.124265 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.124487 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.124572 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.124800 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.124883 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.125140 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.125239 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.125465 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.125713 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.125797 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.126048 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.126140 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.126370 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.126457 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.126681 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.126764 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.126994 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.127078 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.127373 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.127473 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.127631 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.127724 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.127941 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.128026 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.128251 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.128338 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.128558 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.128649 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.128862 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.128978 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.129199 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.129283 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.129511 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.129603 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.129828 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.130068 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.130154 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.130398 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.130483 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.130713 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.130797 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.131025 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.131110 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.131333 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.131417 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.131649 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.131797 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.131980 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.132068 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.132293 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.132385 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.132605 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.132691 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.132912 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.133030 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.133252 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.133337 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.133556 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.133639 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.133863 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.133949 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.134175 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.134259 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.134482 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.134567 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.134785 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.134877 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.135089 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.135173 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.135396 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.135479 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.135702 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.135788 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.136008 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.136091 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.136342 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.136425 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.136651 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.136745 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.136990 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.137091 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.137300 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.137391 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.137614 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.138221 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.138511 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.138608 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.138821 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.139033 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.139118 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.139352 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.139439 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.139661 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.139745 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.139973 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.140132 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.140280 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.140365 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.140625 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.140709 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.140940 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.141044 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.141268 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.141377 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.141586 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.141671 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.141902 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.141997 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.142216 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.142365 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.142530 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.142658 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.142843 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.142972 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.143153 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.143283 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.143459 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.143588 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.143763 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.143893 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.144071 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.144199 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.144378 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.144513 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.144683 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.144812 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.145014 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.145145 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.145327 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.145483 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.145627 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.145760 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.145933 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.146069 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.146234 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.146384 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.146544 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.146672 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.146847 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.146981 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.147154 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.147294 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.147467 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.147596 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.147752 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.147890 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.148058 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.148200 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.148367 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.148497 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.148695 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.148844 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.149031 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.149173 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.149308 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.149463 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.149607 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.149740 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.149893 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.150030 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.150236 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.150529 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.150680 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.150841 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.150979 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.151148 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.151295 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.151454 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.151612 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.151768 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.151926 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.152080 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.152235 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.152386 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.152563 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.152693 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.152877 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.153023 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.153378 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.154024 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.154280 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.154940 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.155052 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.155135 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.155213 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.155290 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.155374 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.155460 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.155539 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.155698 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.155815 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.156043 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.156149 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.156354 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.156472 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.156716 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.156802 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.157052 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.157153 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.157373 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.157459 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.157697 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.157782 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.158005 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.158095 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.158316 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.158401 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.158619 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.158710 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.158928 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.159020 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.159236 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.159321 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.159543 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.159629 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.159852 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.159945 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.160158 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.160241 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.160465 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.160557 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.160772 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.160873 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.161107 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.161194 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.161415 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.161499 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.161746 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.161839 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.162054 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.162184 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.162390 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.162477 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.162700 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.162787 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.163017 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.163102 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.163335 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.163419 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.163646 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.163732 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.163958 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.164041 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.164270 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.164353 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.164576 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.164661 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.164890 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.164988 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.165233 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.165329 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.165547 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.165633 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.165857 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.165948 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.166166 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.166264 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.166480 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.166564 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.166793 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.166878 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.167102 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.167196 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.167423 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.167507 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.167737 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.167829 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.168049 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.168142 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.168353 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.168437 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.168663 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.168746 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.169023 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.169142 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.169428 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.169513 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.169867 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.170049 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.170208 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.170297 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.170494 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.170612 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.170807 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.170932 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.171126 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.171249 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.171443 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.171566 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.171771 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.171867 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.172094 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.172180 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.172407 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.172505 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.172775 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.172859 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.173117 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.173208 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.173447 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.173523 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.173766 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.173854 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.174868 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.175041 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.175190 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.175361 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.175505 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.175687 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.175825 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.176024 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.176131 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.176341 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.176567 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.176661 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.176887 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.176992 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.177235 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.177320 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.177547 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.177643 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.177861 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.177946 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.178174 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.178324 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.178494 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.178643 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.178813 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.178955 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.179122 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.179380 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.179543 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.179700 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.179859 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.180017 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.180173 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.180345 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.180487 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.180674 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.180803 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.181032 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.181132 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.181348 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.181442 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.181668 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.181760 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.181985 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.182070 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.182321 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.182466 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.182663 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.182752 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.182939 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.183033 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.183248 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.183336 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.183557 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.183640 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.183885 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.183970 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.184212 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.184298 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.184695 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.184882 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.184985 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.185332 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.185459 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.185665 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.185794 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.185990 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.186114 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.186323 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.186444 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.186654 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.186777 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.186985 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.187077 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.187298 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.187384 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.187619 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.187711 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.187932 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.188016 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.188260 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.188346 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.188586 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.188695 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.188895 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.188999 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.189236 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.189333 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.189546 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.189632 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.189858 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.189943 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.190169 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.190253 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.190481 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.190575 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.190803 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.190886 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.191111 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.191204 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.191440 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.191526 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.191761 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.191845 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.192088 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.192181 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.192418 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.192559 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.192737 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.192859 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.193067 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.193178 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.193381 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.193480 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.193686 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.193783 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.193991 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.194361 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.194562 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.194658 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.194877 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.194972 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.195193 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.195290 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.195507 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.195603 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.195820 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.195917 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.196127 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.196224 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.196436 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.196532 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.196762 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.196857 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.197097 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.197194 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.197424 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.197530 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.197742 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.197839 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.198067 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.198170 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.198375 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.198477 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.198684 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.198789 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.198998 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.199095 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.199309 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.199404 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.199614 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.199716 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.199917 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.200012 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.200836 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.200960 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.201202 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.201529 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.201636 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.201811 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.201896 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.202138 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.202224 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.202448 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.202535 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.202780 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.202927 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.203094 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.203190 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.203401 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.203487 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.203709 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.203795 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.204014 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.204113 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.204362 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.204448 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.204671 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.204756 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.205012 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.205136 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.205326 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.205423 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.205644 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.205748 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.205953 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.206068 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.206262 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.206358 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.206574 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.206670 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.206887 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.207000 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.207195 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.207291 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.207499 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.207585 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.207806 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.207894 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.208131 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.208251 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.208439 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.208612 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.208764 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.208950 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.209102 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.209309 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.209396 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.209631 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.209733 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.209974 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.210061 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.210322 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.210409 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.210629 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.210887 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.210980 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.211225 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.211313 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.211546 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.211662 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.211866 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.211965 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.212181 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.212276 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.212500 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.212635 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.212816 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.212935 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.213159 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.213253 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.213476 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.213571 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.213789 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.213875 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.214105 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.214190 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.214426 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.214513 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.214744 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.214830 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.215057 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.215149 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.215375 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.215462 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.215691 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.215785 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.216685 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.216778 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.217037 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.217365 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.217480 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.217733 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.217823 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.218059 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.218148 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.218376 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.218464 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.218701 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.218789 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.219026 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.219114 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.219347 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.219433 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.219662 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.219747 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.219976 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.220125 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.220289 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.220375 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.220603 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.220731 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.220929 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.221018 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.221253 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.221342 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.221576 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.221672 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.221899 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.222016 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.222226 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.222364 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.222546 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.222685 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.222884 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.223036 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.223186 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.223275 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.223504 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.223591 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.223828 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.223921 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.224158 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.224348 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.224478 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.224671 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.224797 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.225033 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.225150 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.225368 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.225463 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.225700 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.225786 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.226022 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.226108 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.226344 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.226430 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.226670 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.226753 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.226980 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.227063 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.227291 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.227386 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.227605 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.227689 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.227915 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.228013 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.228224 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.228316 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.228547 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.228634 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.228861 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.228980 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.229197 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.229282 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.229512 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.229604 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.229822 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.230034 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.230353 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.230444 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.230691 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.230777 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.231007 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.231100 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.231335 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.231452 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.231753 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.231854 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.232075 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.232280 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.232375 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.232619 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.232703 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.233245 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.233399 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.233399 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.233602 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.233706 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.233810 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.233927 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.234044 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.234242 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.234355 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.234556 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.234668 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.234870 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.234989 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.235180 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.235298 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.235487 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.235598 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.236951 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.237150 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.237150 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.237471 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.237622 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.238225 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.238315 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.238394 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.238472 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.238550 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.238635 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.238635 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.238790 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.238868 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.238954 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.239034 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.239112 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.239197 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.239277 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.239354 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.239432 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.239509 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.239595 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.239675 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.239763 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.239843 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.239921 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.239998 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.240085 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.240299 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.240387 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.240610 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.240705 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.240965 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.241245 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.241355 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.241437 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.241548 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.241645 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.241852 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.241948 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.242162 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.242333 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.242473 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.242611 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.242758 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.242902 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.243058 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.243215 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.243360 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.243490 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.243668 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.243811 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.243976 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.244107 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.244281 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.244412 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.244586 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.244869 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.244974 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.245235 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.245346 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.245550 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.245673 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.245863 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.245984 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.246179 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.246290 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.246487 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.246599 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.246797 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.246908 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.247236 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.247393 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.247572 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.248952 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.249145 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.249328 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.249482 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.249639 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.249861 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.249965 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.250056 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.250148 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.250239 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.250369 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.250468 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.250551 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.250630 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.250709 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.250788 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.250788 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.250946 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.251025 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.251112 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.251192 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.251271 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.251357 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.251536 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.251625 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.251859 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.251954 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.252197 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.252342 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.252502 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.252591 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.252818 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.252905 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.253167 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.253345 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.253482 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.253568 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.253786 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.253899 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.254097 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.254184 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.254426 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.254690 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.254775 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.255013 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.255145 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.255326 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.255467 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.255640 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.255792 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.255953 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.256133 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.256266 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.256418 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.256577 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.256746 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.256889 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.257098 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.257227 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.257417 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.257561 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.257742 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.257883 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.258057 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.258200 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.258389 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.258516 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.258730 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.258823 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.259064 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.259150 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.259392 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.259477 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.259705 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.259792 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.260015 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.260101 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.260324 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.260409 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.260638 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.260726 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.260975 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.261076 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.261288 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.261374 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.261628 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.261715 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.261993 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.262079 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.262386 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.262494 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.262641 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.263294 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.263694 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.263869 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.264021 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.264117 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.264346 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.264431 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.264661 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.264746 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.264998 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.265101 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.265316 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.265408 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.265644 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.265728 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.265964 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.266058 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.266280 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.266367 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.266597 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.266683 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.266907 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.266994 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.267215 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.267301 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.267526 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.267628 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.267837 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.267925 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.268158 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.268242 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.268488 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.268578 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.268802 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.268895 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.269199 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.269293 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.269466 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.269565 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.269778 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.269864 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.270087 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.270172 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.270411 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.270504 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.270728 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.270812 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.271043 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.271127 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.271354 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.271458 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.271673 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.271757 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.271984 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.272068 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.272298 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.272384 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.272611 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.272717 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.272957 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.273106 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.273261 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.273349 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.273574 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.273681 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.273900 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.273987 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.274226 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.274314 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.274533 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.274628 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.274858 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.274952 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.275176 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.275279 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.275493 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.275579 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.275741 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 18 16:21:36.275837 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.276106 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.276435 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.276747 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.277087 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.277402 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.277715 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.278032 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.278399 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.279476 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.279822 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.280158 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.280494 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.280864 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.281196 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.281547 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.281882 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.282203 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.282519 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.282831 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:21:36.283079 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 18 16:21:36.298818 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG oslo_db.sqlalchemy.engines [None req-6d4150a2-c625-4e9c-8d0e-00283c8d6470 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 18 16:21:36.305861 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG oslo_db.sqlalchemy.engines [None req-1a865e39-afbe-4c36-8903-68bbaa1851d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101726) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 18 16:21:36.366516 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.context [None req-6d4150a2-c625-4e9c-8d0e-00283c8d6470 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),893648b7-9c61-4bb4-8054-545f5288e2ec(cell1) {{(pid=101725) load_cells /opt/stack/nova/nova/context.py:464}} Jan 18 16:21:36.370724 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG oslo_concurrency.lockutils [None req-6d4150a2-c625-4e9c-8d0e-00283c8d6470 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:21:36.372950 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG oslo_concurrency.lockutils [None req-6d4150a2-c625-4e9c-8d0e-00283c8d6470 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:21:36.373762 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG oslo_concurrency.lockutils [None req-6d4150a2-c625-4e9c-8d0e-00283c8d6470 None None] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:21:36.374032 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.context [None req-1a865e39-afbe-4c36-8903-68bbaa1851d7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),893648b7-9c61-4bb4-8054-545f5288e2ec(cell1) {{(pid=101726) load_cells /opt/stack/nova/nova/context.py:464}} Jan 18 16:21:36.375718 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG oslo_concurrency.lockutils [None req-6d4150a2-c625-4e9c-8d0e-00283c8d6470 None None] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:21:36.378225 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG oslo_concurrency.lockutils [None req-1a865e39-afbe-4c36-8903-68bbaa1851d7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:21:36.379787 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG oslo_concurrency.lockutils [None req-1a865e39-afbe-4c36-8903-68bbaa1851d7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:21:36.380585 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG oslo_concurrency.lockutils [None req-1a865e39-afbe-4c36-8903-68bbaa1851d7 None None] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:21:36.382551 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG oslo_concurrency.lockutils [None req-1a865e39-afbe-4c36-8903-68bbaa1851d7 None None] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:21:36.389770 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG oslo_db.sqlalchemy.engines [None req-6d4150a2-c625-4e9c-8d0e-00283c8d6470 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 18 16:21:36.390594 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG oslo_db.sqlalchemy.engines [None req-6d4150a2-c625-4e9c-8d0e-00283c8d6470 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 18 16:21:36.395519 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG oslo_db.sqlalchemy.engines [None req-1a865e39-afbe-4c36-8903-68bbaa1851d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101726) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 18 16:21:36.398890 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG oslo_db.sqlalchemy.engines [None req-1a865e39-afbe-4c36-8903-68bbaa1851d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101726) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 18 16:21:36.562549 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG oslo_db.sqlalchemy.engines [None req-1a865e39-afbe-4c36-8903-68bbaa1851d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101726) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 18 16:21:36.565168 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG oslo_db.sqlalchemy.engines [None req-6d4150a2-c625-4e9c-8d0e-00283c8d6470 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 18 16:21:36.907731 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: WARNING keystonemiddleware.auth_token [None req-6d4150a2-c625-4e9c-8d0e-00283c8d6470 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 18 16:21:36.910736 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: WARNING keystonemiddleware.auth_token [None req-1a865e39-afbe-4c36-8903-68bbaa1851d7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 18 16:21:36.914370 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: WARNING keystonemiddleware.auth_token [None req-6d4150a2-c625-4e9c-8d0e-00283c8d6470 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 18 16:21:36.917382 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: WARNING keystonemiddleware.auth_token [None req-1a865e39-afbe-4c36-8903-68bbaa1851d7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 18 16:21:37.254757 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: WARNING keystonemiddleware.auth_token [None req-6d4150a2-c625-4e9c-8d0e-00283c8d6470 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 18 16:21:37.260100 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: WARNING keystonemiddleware.auth_token [None req-6d4150a2-c625-4e9c-8d0e-00283c8d6470 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 18 16:21:37.265419 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562cf17fb9c0 pid: 101725 (default app) Jan 18 16:21:37.267488 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi [None req-6d4150a2-c625-4e9c-8d0e-00283c8d6470 None None] Calling method '>' {{(pid=101725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:21:37.269062 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: INFO nova.api.openstack.requestlog [None req-6d4150a2-c625-4e9c-8d0e-00283c8d6470 None None] 10.222.0.82 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001804 Jan 18 16:21:37.269572 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: WARNING keystonemiddleware.auth_token [None req-1a865e39-afbe-4c36-8903-68bbaa1851d7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 18 16:21:37.269967 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: [pid: 101725|app: 0|req: 1/1] 10.222.0.82 () {50 vars in 788 bytes} [Tue Jan 18 16:21:37 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:21:37.275507 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: WARNING keystonemiddleware.auth_token [None req-1a865e39-afbe-4c36-8903-68bbaa1851d7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 18 16:21:37.281703 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562cf17fb9c0 pid: 101726 (default app) Jan 18 16:23:03.799378 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi [None req-6d4150a2-c625-4e9c-8d0e-00283c8d6470 None None] Calling method '>' {{(pid=101725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:23:03.800370 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: INFO nova.api.openstack.requestlog [None req-6d4150a2-c625-4e9c-8d0e-00283c8d6470 None None] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 Jan 18 16:23:03.800762 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: [pid: 101725|app: 0|req: 2/2] 10.222.0.82 () {54 vars in 930 bytes} [Tue Jan 18 16:23:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:23:04.252757 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-0a6be8cb-88a7-4277-b93b-786dce8ae638 admin admin] Calling method '>' {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:23:04.281983 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-0a6be8cb-88a7-4277-b93b-786dce8ae638 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.474273 Jan 18 16:23:04.282776 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 1/3] 10.222.0.82 () {60 vars in 1291 bytes} [Tue Jan 18 16:23:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:23:06.540279 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi [None req-6d4150a2-c625-4e9c-8d0e-00283c8d6470 None None] Calling method '>' {{(pid=101725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:23:06.541353 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: INFO nova.api.openstack.requestlog [None req-6d4150a2-c625-4e9c-8d0e-00283c8d6470 None None] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jan 18 16:23:06.541778 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: [pid: 101725|app: 0|req: 3/4] 10.222.0.82 () {54 vars in 930 bytes} [Tue Jan 18 16:23:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:23:06.607222 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-b7702c7e-8e3d-45d5-a19c-5e19a3899da0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "name": "cirros256", "ram": 256, "disk": 1, "id": "c1", "vcpus": 1}} {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:23:06.626334 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:23:06.626334 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: warnings.warn(msg) Jan 18 16:23:06.655148 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-b7702c7e-8e3d-45d5-a19c-5e19a3899da0 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.107059 Jan 18 16:23:06.655912 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 2/5] 10.222.0.82 () {64 vars in 1282 bytes} [Tue Jan 18 16:23:06 2022] POST /compute/v2.1/flavors => generated 407 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 18 16:23:06.881437 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi [None req-533151f1-de14-4982-8345-b22de139f57f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:23:06.883681 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:23:06.883681 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: warnings.warn(msg) Jan 18 16:23:06.933914 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: INFO nova.api.openstack.requestlog [None req-533151f1-de14-4982-8345-b22de139f57f admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.269770 Jan 18 16:23:06.934693 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: [pid: 101725|app: 0|req: 4/6] 10.222.0.82 () {64 vars in 1335 bytes} [Tue Jan 18 16:23:06 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:23:09.222019 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-b7702c7e-8e3d-45d5-a19c-5e19a3899da0 admin admin] Calling method '>' {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:23:09.223036 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-b7702c7e-8e3d-45d5-a19c-5e19a3899da0 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jan 18 16:23:09.223612 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 3/7] 10.222.0.82 () {54 vars in 930 bytes} [Tue Jan 18 16:23:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:23:09.340535 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi [None req-3b358246-5ea2-40f2-bc9e-88745acbbaef admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "id": "d1", "vcpus": 1, "rxtx_factor": 1.0, "ram": 512}} {{(pid=101725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:23:09.359174 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:23:09.359174 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: warnings.warn(msg) Jan 18 16:23:09.380002 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: INFO nova.api.openstack.requestlog [None req-3b358246-5ea2-40f2-bc9e-88745acbbaef admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.150628 Jan 18 16:23:09.380538 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: [pid: 101725|app: 0|req: 5/8] 10.222.0.82 () {64 vars in 1282 bytes} [Tue Jan 18 16:23:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:23:09.392226 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-5fd160a5-477f-46a1-87fd-a7a199be4ef1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:23:09.398277 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:23:09.398277 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: warnings.warn(msg) Jan 18 16:23:09.427119 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-5fd160a5-477f-46a1-87fd-a7a199be4ef1 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038530 Jan 18 16:23:09.427703 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 4/9] 10.222.0.82 () {64 vars in 1335 bytes} [Tue Jan 18 16:23:09 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:23:11.710914 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi [None req-3b358246-5ea2-40f2-bc9e-88745acbbaef admin admin] Calling method '>' {{(pid=101725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:23:11.711923 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: INFO nova.api.openstack.requestlog [None req-3b358246-5ea2-40f2-bc9e-88745acbbaef admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jan 18 16:23:11.712323 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: [pid: 101725|app: 0|req: 6/10] 10.222.0.82 () {54 vars in 930 bytes} [Tue Jan 18 16:23:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:23:11.773806 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-3be1be50-ace2-4259-876c-cc6ef1e998b1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "rxtx_factor": 1.0, "vcpus": 1, "disk": 10, "os-flavor-access:is_public": true, "id": "d2"}} {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:23:11.793246 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-3be1be50-ace2-4259-876c-cc6ef1e998b1 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074176 Jan 18 16:23:11.800324 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 5/11] 10.222.0.82 () {64 vars in 1282 bytes} [Tue Jan 18 16:23:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:23:11.806481 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi [None req-e9433276-19de-4526-90cc-beee96d2e620 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:23:11.834398 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: INFO nova.api.openstack.requestlog [None req-e9433276-19de-4526-90cc-beee96d2e620 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031976 Jan 18 16:23:11.835635 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: [pid: 101725|app: 0|req: 7/12] 10.222.0.82 () {64 vars in 1335 bytes} [Tue Jan 18 16:23:11 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:23:14.200130 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-3be1be50-ace2-4259-876c-cc6ef1e998b1 admin admin] Calling method '>' {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:23:14.201242 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-3be1be50-ace2-4259-876c-cc6ef1e998b1 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Jan 18 16:23:14.201678 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 6/13] 10.222.0.82 () {54 vars in 930 bytes} [Tue Jan 18 16:23:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:23:14.264191 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi [None req-3edcb99c-5a26-45e5-8c6b-008d9b4a34cd admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 10, "id": "d3", "ram": 2048, "name": "ds2G", "swap": 0, "vcpus": 2}} {{(pid=101725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:23:14.282791 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: INFO nova.api.openstack.requestlog [None req-3edcb99c-5a26-45e5-8c6b-008d9b4a34cd admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074934 Jan 18 16:23:14.283362 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: [pid: 101725|app: 0|req: 8/14] 10.222.0.82 () {64 vars in 1282 bytes} [Tue Jan 18 16:23:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:23:14.295740 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-2a20901d-d557-4241-815b-931d24e8be70 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:23:14.320126 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-2a20901d-d557-4241-815b-931d24e8be70 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028270 Jan 18 16:23:14.320820 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 7/15] 10.222.0.82 () {64 vars in 1335 bytes} [Tue Jan 18 16:23:14 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:23:16.616600 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi [None req-3edcb99c-5a26-45e5-8c6b-008d9b4a34cd admin admin] Calling method '>' {{(pid=101725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:23:16.617632 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: INFO nova.api.openstack.requestlog [None req-3edcb99c-5a26-45e5-8c6b-008d9b4a34cd admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jan 18 16:23:16.618208 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: [pid: 101725|app: 0|req: 9/16] 10.222.0.82 () {54 vars in 930 bytes} [Tue Jan 18 16:23:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:23:16.683736 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-e2cbd383-cbab-4955-ac3f-4c905e1b0f41 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 4, "name": "ds4G", "ram": 4096, "disk": 20}} {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:23:16.702595 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-e2cbd383-cbab-4955-ac3f-4c905e1b0f41 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077957 Jan 18 16:23:16.703143 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 8/17] 10.222.0.82 () {64 vars in 1282 bytes} [Tue Jan 18 16:23:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:23:16.715645 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi [None req-8bbc1fe2-39c9-4e8f-83e7-96ca646e5caa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:23:16.737942 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: INFO nova.api.openstack.requestlog [None req-8bbc1fe2-39c9-4e8f-83e7-96ca646e5caa admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026752 Jan 18 16:23:16.738518 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: [pid: 101725|app: 0|req: 10/18] 10.222.0.82 () {64 vars in 1335 bytes} [Tue Jan 18 16:23:16 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:23:19.016859 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-e2cbd383-cbab-4955-ac3f-4c905e1b0f41 admin admin] Calling method '>' {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:23:19.017914 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-e2cbd383-cbab-4955-ac3f-4c905e1b0f41 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Jan 18 16:23:19.018326 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 9/19] 10.222.0.82 () {54 vars in 930 bytes} [Tue Jan 18 16:23:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:23:19.078710 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi [None req-c2b616b2-3aea-4f9c-b19f-8722f02c8624 admin admin] Calling method '>' {{(pid=101725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:23:19.102260 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: INFO nova.api.openstack.requestlog [None req-c2b616b2-3aea-4f9c-b19f-8722f02c8624 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.077982 Jan 18 16:23:19.102822 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: [pid: 101725|app: 0|req: 11/20] 10.222.0.82 () {60 vars in 1291 bytes} [Tue Jan 18 16:23:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:23:21.537411 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-e2cbd383-cbab-4955-ac3f-4c905e1b0f41 admin admin] Calling method '>' {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:23:21.538456 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-e2cbd383-cbab-4955-ac3f-4c905e1b0f41 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Jan 18 16:23:21.538873 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 10/21] 10.222.0.82 () {54 vars in 930 bytes} [Tue Jan 18 16:23:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:23:21.601439 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi [None req-b1499396-26ac-4982-af48-e7d72c20470c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "os-flavor-access:is_public": true, "name": "m1.tiny", "disk": 1, "swap": 0, "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=101725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:23:21.621643 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: INFO nova.api.openstack.requestlog [None req-b1499396-26ac-4982-af48-e7d72c20470c admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.075856 Jan 18 16:23:21.622189 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: [pid: 101725|app: 0|req: 12/22] 10.222.0.82 () {64 vars in 1282 bytes} [Tue Jan 18 16:23:21 2022] POST /compute/v2.1/flavors => generated 402 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:23:21.634153 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-eefd78e3-ae73-4333-978a-726da5f457f1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:23:21.658215 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-eefd78e3-ae73-4333-978a-726da5f457f1 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027960 Jan 18 16:23:21.658723 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 11/23] 10.222.0.82 () {64 vars in 1332 bytes} [Tue Jan 18 16:23:21 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:23:24.411790 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi [None req-b1499396-26ac-4982-af48-e7d72c20470c admin admin] Calling method '>' {{(pid=101725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:23:24.412869 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: INFO nova.api.openstack.requestlog [None req-b1499396-26ac-4982-af48-e7d72c20470c admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jan 18 16:23:24.413304 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: [pid: 101725|app: 0|req: 13/24] 10.222.0.82 () {54 vars in 930 bytes} [Tue Jan 18 16:23:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:23:24.476258 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-b8b4463d-e3d8-4f89-810b-7dae0408656b admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "ram": 2048, "name": "m1.small", "vcpus": 1, "swap": 0, "disk": 20, "rxtx_factor": 1.0}} {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:23:24.495574 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-b8b4463d-e3d8-4f89-810b-7dae0408656b admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.074719 Jan 18 16:23:24.496096 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 12/25] 10.222.0.82 () {64 vars in 1282 bytes} [Tue Jan 18 16:23:24 2022] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:23:24.507965 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi [None req-58e29a9c-b619-42fa-9d2a-fb77a3b5fc66 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:23:24.533110 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: INFO nova.api.openstack.requestlog [None req-58e29a9c-b619-42fa-9d2a-fb77a3b5fc66 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029022 Jan 18 16:23:24.533697 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: [pid: 101725|app: 0|req: 14/26] 10.222.0.82 () {64 vars in 1332 bytes} [Tue Jan 18 16:23:24 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:23:26.941255 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-b8b4463d-e3d8-4f89-810b-7dae0408656b admin admin] Calling method '>' {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:23:26.942368 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-b8b4463d-e3d8-4f89-810b-7dae0408656b admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001712 Jan 18 16:23:26.942583 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 13/27] 10.222.0.82 () {54 vars in 930 bytes} [Tue Jan 18 16:23:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:23:27.003334 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi [None req-6bc451b1-bf1d-4244-be43-5f8bbea8adbc admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 4096, "os-flavor-access:is_public": true, "name": "m1.medium", "disk": 40, "vcpus": 2, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3"}} {{(pid=101725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:23:27.021802 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: INFO nova.api.openstack.requestlog [None req-6bc451b1-bf1d-4244-be43-5f8bbea8adbc admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.071905 Jan 18 16:23:27.022361 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: [pid: 101725|app: 0|req: 15/28] 10.222.0.82 () {64 vars in 1282 bytes} [Tue Jan 18 16:23:26 2022] POST /compute/v2.1/flavors => generated 406 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:23:27.035158 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-21c676e5-7e78-4387-ba49-cfaa513c22f0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:23:27.057964 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-21c676e5-7e78-4387-ba49-cfaa513c22f0 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026484 Jan 18 16:23:27.058549 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 14/29] 10.222.0.82 () {64 vars in 1332 bytes} [Tue Jan 18 16:23:27 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:23:29.348084 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi [None req-6bc451b1-bf1d-4244-be43-5f8bbea8adbc admin admin] Calling method '>' {{(pid=101725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:23:29.349117 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: INFO nova.api.openstack.requestlog [None req-6bc451b1-bf1d-4244-be43-5f8bbea8adbc admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jan 18 16:23:29.349519 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: [pid: 101725|app: 0|req: 16/30] 10.222.0.82 () {54 vars in 930 bytes} [Tue Jan 18 16:23:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:23:29.408550 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-44b798fa-e960-4f25-b1a3-2b2fd15d908c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "ram": 8192, "name": "m1.large", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "disk": 80, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:23:29.427185 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-44b798fa-e960-4f25-b1a3-2b2fd15d908c admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.071097 Jan 18 16:23:29.427897 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 15/31] 10.222.0.82 () {64 vars in 1282 bytes} [Tue Jan 18 16:23:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:23:29.439525 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi [None req-fe2947cc-ca7b-4dd0-a6d8-d4d0542d4cdf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:23:29.470743 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: INFO nova.api.openstack.requestlog [None req-fe2947cc-ca7b-4dd0-a6d8-d4d0542d4cdf admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034874 Jan 18 16:23:29.471422 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: [pid: 101725|app: 0|req: 17/32] 10.222.0.82 () {64 vars in 1332 bytes} [Tue Jan 18 16:23:29 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:23:31.767702 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-44b798fa-e960-4f25-b1a3-2b2fd15d908c admin admin] Calling method '>' {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:23:31.768700 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-44b798fa-e960-4f25-b1a3-2b2fd15d908c admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jan 18 16:23:31.769297 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 16/33] 10.222.0.82 () {54 vars in 930 bytes} [Tue Jan 18 16:23:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:23:31.837200 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi [None req-9798cd8e-867c-493c-bdd7-9dcf4b15cc7e admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 16384, "name": "m1.xlarge", "swap": 0, "rxtx_factor": 1.0, "disk": 160, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5"}} {{(pid=101725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:23:31.859052 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: INFO nova.api.openstack.requestlog [None req-9798cd8e-867c-493c-bdd7-9dcf4b15cc7e admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.083915 Jan 18 16:23:31.859521 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: [pid: 101725|app: 0|req: 18/34] 10.222.0.82 () {64 vars in 1282 bytes} [Tue Jan 18 16:23:31 2022] POST /compute/v2.1/flavors => generated 408 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 18 16:23:31.873073 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-9d57b96a-484a-4fac-91b7-cff18d8e78ca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:23:31.901979 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-9d57b96a-484a-4fac-91b7-cff18d8e78ca admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033363 Jan 18 16:23:31.903179 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 17/35] 10.222.0.82 () {64 vars in 1332 bytes} [Tue Jan 18 16:23:31 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:23:55.147295 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi [None req-9798cd8e-867c-493c-bdd7-9dcf4b15cc7e admin admin] Calling method '>' {{(pid=101725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:23:55.148302 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: INFO nova.api.openstack.requestlog [None req-9798cd8e-867c-493c-bdd7-9dcf4b15cc7e admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Jan 18 16:23:55.148703 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: [pid: 101725|app: 0|req: 19/36] 10.222.0.82 () {54 vars in 930 bytes} [Tue Jan 18 16:23:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:23:55.205283 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-ee6989b3-ae15-4eee-81d2-0867dd8dcef0 admin admin] Calling method '>' {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:23:55.223233 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-ee6989b3-ae15-4eee-81d2-0867dd8dcef0 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068240 Jan 18 16:23:55.223770 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 18/37] 10.222.0.82 () {60 vars in 1291 bytes} [Tue Jan 18 16:23:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 16:23:56.606853 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi [None req-9798cd8e-867c-493c-bdd7-9dcf4b15cc7e admin admin] Calling method '>' {{(pid=101725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:23:56.607857 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: INFO nova.api.openstack.requestlog [None req-9798cd8e-867c-493c-bdd7-9dcf4b15cc7e admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Jan 18 16:23:56.608258 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: [pid: 101725|app: 0|req: 20/38] 10.222.0.82 () {56 vars in 1074 bytes} [Tue Jan 18 16:23:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:23:56.818621 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-0cb01f80-c517-49c4-b65c-3d556855c14e admin admin] Calling method '>' {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:23:56.825328 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.wsgi [None req-0cb01f80-c517-49c4-b65c-3d556855c14e admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 18 16:23:56.825896 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-0cb01f80-c517-49c4-b65c-3d556855c14e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 16:23:56.826717 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-0cb01f80-c517-49c4-b65c-3d556855c14e admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062372 Jan 18 16:23:56.827255 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 19/39] 10.222.0.82 () {60 vars in 1190 bytes} [Tue Jan 18 16:23:56 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 18 16:23:56.836739 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi [None req-25e7cbe4-db29-40b0-83d6-f4689e3da165 admin admin] Calling method '>' {{(pid=101725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:23:56.857751 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: INFO nova.api.openstack.requestlog [None req-25e7cbe4-db29-40b0-83d6-f4689e3da165 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024627 Jan 18 16:23:56.858313 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: [pid: 101725|app: 0|req: 21/40] 10.222.0.82 () {60 vars in 1210 bytes} [Tue Jan 18 16:23:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:23:56.869843 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-bd5a90ba-f553-4b31-81a5-c2ade44ad239 admin admin] Calling method '>' {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:23:56.891530 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-bd5a90ba-f553-4b31-81a5-c2ade44ad239 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025693 Jan 18 16:23:56.892099 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 20/41] 10.222.0.82 () {60 vars in 1210 bytes} [Tue Jan 18 16:23:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 16:23:56.901965 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi [None req-a442df51-fd18-49b0-a991-42247f3cdd8f admin admin] Calling method '>' {{(pid=101725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:23:56.909060 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: INFO nova.api.openstack.wsgi [None req-a442df51-fd18-49b0-a991-42247f3cdd8f admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 18 16:23:56.909625 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi [None req-a442df51-fd18-49b0-a991-42247f3cdd8f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 16:23:56.910408 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: INFO nova.api.openstack.requestlog [None req-a442df51-fd18-49b0-a991-42247f3cdd8f admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.012392 Jan 18 16:23:56.910918 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: [pid: 101725|app: 0|req: 22/42] 10.222.0.82 () {60 vars in 1190 bytes} [Tue Jan 18 16:23:56 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 18 16:23:58.195450 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-bd5a90ba-f553-4b31-81a5-c2ade44ad239 admin admin] Calling method '>' {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:23:58.197985 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-bd5a90ba-f553-4b31-81a5-c2ade44ad239 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002930 Jan 18 16:23:58.198394 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 21/43] 10.222.0.82 () {56 vars in 1074 bytes} [Tue Jan 18 16:23:58 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:23:58.395252 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi [None req-02b15f45-2756-4663-b237-2da709069e3d admin admin] Calling method '>' {{(pid=101725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:23:58.401123 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: INFO nova.api.openstack.wsgi [None req-02b15f45-2756-4663-b237-2da709069e3d admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 18 16:23:58.401680 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi [None req-02b15f45-2756-4663-b237-2da709069e3d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 16:23:58.402465 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: INFO nova.api.openstack.requestlog [None req-02b15f45-2756-4663-b237-2da709069e3d admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058709 Jan 18 16:23:58.402971 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: [pid: 101725|app: 0|req: 23/44] 10.222.0.82 () {60 vars in 1190 bytes} [Tue Jan 18 16:23:58 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 18 16:23:58.412308 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-5a63202f-1a73-4a01-9b7c-1bc850e0d4e3 admin admin] Calling method '>' {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:23:58.426468 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-5a63202f-1a73-4a01-9b7c-1bc850e0d4e3 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017831 Jan 18 16:23:58.426978 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 22/45] 10.222.0.82 () {60 vars in 1210 bytes} [Tue Jan 18 16:23:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 16:23:58.437255 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi [None req-25975c72-4309-4092-ae6f-12f64b3e12ae admin admin] Calling method '>' {{(pid=101725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:23:58.451685 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: INFO nova.api.openstack.requestlog [None req-25975c72-4309-4092-ae6f-12f64b3e12ae admin admin] 10.222.0.82 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017805 Jan 18 16:23:58.452215 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: [pid: 101725|app: 0|req: 24/46] 10.222.0.82 () {60 vars in 1210 bytes} [Tue Jan 18 16:23:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:23:58.461217 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-783f005f-a8b6-44a0-a65e-a00b36b5f789 admin admin] Calling method '>' {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:23:58.467595 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.wsgi [None req-783f005f-a8b6-44a0-a65e-a00b36b5f789 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 18 16:23:58.468169 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-783f005f-a8b6-44a0-a65e-a00b36b5f789 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 16:23:58.469066 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-783f005f-a8b6-44a0-a65e-a00b36b5f789 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011301 Jan 18 16:23:58.469597 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 23/47] 10.222.0.82 () {60 vars in 1190 bytes} [Tue Jan 18 16:23:58 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jan 18 16:23:59.791181 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi [None req-25975c72-4309-4092-ae6f-12f64b3e12ae admin admin] Calling method '>' {{(pid=101725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:23:59.792171 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: INFO nova.api.openstack.requestlog [None req-25975c72-4309-4092-ae6f-12f64b3e12ae admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jan 18 16:23:59.792565 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: [pid: 101725|app: 0|req: 25/48] 10.222.0.82 () {56 vars in 1074 bytes} [Tue Jan 18 16:23:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:23:59.988410 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-2f33b408-b68f-442e-95a3-ccc8527babd6 admin admin] Calling method '>' {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:23:59.993986 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.wsgi [None req-2f33b408-b68f-442e-95a3-ccc8527babd6 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 18 16:23:59.994602 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-2f33b408-b68f-442e-95a3-ccc8527babd6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 16:23:59.995471 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-2f33b408-b68f-442e-95a3-ccc8527babd6 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059268 Jan 18 16:23:59.995979 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 24/49] 10.222.0.82 () {60 vars in 1193 bytes} [Tue Jan 18 16:23:59 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 18 16:24:00.005265 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi [None req-69ded05d-5131-4802-a203-d658bf6e55cf admin admin] Calling method '>' {{(pid=101725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:24:00.018928 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: INFO nova.api.openstack.requestlog [None req-69ded05d-5131-4802-a203-d658bf6e55cf admin admin] 10.222.0.82 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017150 Jan 18 16:24:00.019450 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: [pid: 101725|app: 0|req: 26/50] 10.222.0.82 () {60 vars in 1210 bytes} [Tue Jan 18 16:24:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:24:00.029893 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-c2a19dc6-2283-4fda-9cbc-64feec954874 admin admin] Calling method '>' {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:24:00.042879 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-c2a19dc6-2283-4fda-9cbc-64feec954874 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016798 Jan 18 16:24:00.043414 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 25/51] 10.222.0.82 () {60 vars in 1210 bytes} [Tue Jan 18 16:24:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:24:00.052326 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi [None req-3e47805a-0df6-432a-a4b4-eb8c01e1392e admin admin] Calling method '>' {{(pid=101725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:24:00.057426 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: INFO nova.api.openstack.wsgi [None req-3e47805a-0df6-432a-a4b4-eb8c01e1392e admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 18 16:24:00.057984 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi [None req-3e47805a-0df6-432a-a4b4-eb8c01e1392e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 16:24:00.058753 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: INFO nova.api.openstack.requestlog [None req-3e47805a-0df6-432a-a4b4-eb8c01e1392e admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.009851 Jan 18 16:24:00.059239 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: [pid: 101725|app: 0|req: 27/52] 10.222.0.82 () {60 vars in 1193 bytes} [Tue Jan 18 16:24:00 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jan 18 16:24:01.318795 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-c2a19dc6-2283-4fda-9cbc-64feec954874 admin admin] Calling method '>' {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:24:01.320049 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-c2a19dc6-2283-4fda-9cbc-64feec954874 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001672 Jan 18 16:24:01.320445 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 26/53] 10.222.0.82 () {56 vars in 1074 bytes} [Tue Jan 18 16:24:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:24:01.515510 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi [None req-d8d317a2-a3e9-42c6-9890-a09842070aaa admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:24:01.533782 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: INFO nova.api.openstack.requestlog [None req-d8d317a2-a3e9-42c6-9890-a09842070aaa admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.068188 Jan 18 16:24:01.534321 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: [pid: 101725|app: 0|req: 28/54] 10.222.0.82 () {64 vars in 1235 bytes} [Tue Jan 18 16:24:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:24:02.787064 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-c2a19dc6-2283-4fda-9cbc-64feec954874 admin admin] Calling method '>' {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:24:02.788056 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-c2a19dc6-2283-4fda-9cbc-64feec954874 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001396 Jan 18 16:24:02.788446 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 27/55] 10.222.0.82 () {56 vars in 1074 bytes} [Tue Jan 18 16:24:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:24:02.984419 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi [None req-d0ca65d3-467a-44ca-9490-ac9111b3c1ec admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:24:03.003312 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: INFO nova.api.openstack.requestlog [None req-d0ca65d3-467a-44ca-9490-ac9111b3c1ec admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.071299 Jan 18 16:24:03.003870 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: [pid: 101725|app: 0|req: 29/56] 10.222.0.82 () {64 vars in 1235 bytes} [Tue Jan 18 16:24:02 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:24:04.263323 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-c2a19dc6-2283-4fda-9cbc-64feec954874 admin admin] Calling method '>' {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:24:04.264374 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-c2a19dc6-2283-4fda-9cbc-64feec954874 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jan 18 16:24:04.264776 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 28/57] 10.222.0.82 () {56 vars in 1074 bytes} [Tue Jan 18 16:24:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:24:04.459110 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi [None req-c513af29-d7ab-45b7-8769-41129e008ba0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:24:04.478728 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: INFO nova.api.openstack.requestlog [None req-c513af29-d7ab-45b7-8769-41129e008ba0 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.071445 Jan 18 16:24:04.479200 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: [pid: 101725|app: 0|req: 30/58] 10.222.0.82 () {64 vars in 1235 bytes} [Tue Jan 18 16:24:04 2022] POST /compute/v2.1/flavors => generated 407 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:24:05.745566 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-c2a19dc6-2283-4fda-9cbc-64feec954874 admin admin] Calling method '>' {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:24:05.746575 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-c2a19dc6-2283-4fda-9cbc-64feec954874 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jan 18 16:24:05.746976 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 29/59] 10.222.0.82 () {56 vars in 1074 bytes} [Tue Jan 18 16:24:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:24:05.943135 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi [None req-b5bf5a67-3e58-4fc4-b7ac-129b3ff89cd1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:24:05.960703 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: INFO nova.api.openstack.requestlog [None req-b5bf5a67-3e58-4fc4-b7ac-129b3ff89cd1 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.068512 Jan 18 16:24:05.961429 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: [pid: 101725|app: 0|req: 31/60] 10.222.0.82 () {64 vars in 1235 bytes} [Tue Jan 18 16:24:05 2022] POST /compute/v2.1/flavors => generated 409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:24:07.220076 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-c2a19dc6-2283-4fda-9cbc-64feec954874 admin admin] Calling method '>' {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:24:07.221103 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-c2a19dc6-2283-4fda-9cbc-64feec954874 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Jan 18 16:24:07.221497 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 30/61] 10.222.0.82 () {56 vars in 1074 bytes} [Tue Jan 18 16:24:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:24:07.417035 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi [None req-5958d0f3-d841-47fe-bb9d-5fb88b3e01f7 admin admin] Calling method '>' {{(pid=101725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:24:07.435594 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: INFO nova.api.openstack.requestlog [None req-5958d0f3-d841-47fe-bb9d-5fb88b3e01f7 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.068899 Jan 18 16:24:07.436069 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: [pid: 101725|app: 0|req: 32/62] 10.222.0.82 () {60 vars in 1202 bytes} [Tue Jan 18 16:24:07 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:24:53.381132 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-c2a19dc6-2283-4fda-9cbc-64feec954874 admin admin] Calling method '>' {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:24:53.382206 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-c2a19dc6-2283-4fda-9cbc-64feec954874 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001580 Jan 18 16:24:53.382604 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 31/63] 10.222.0.82 () {54 vars in 930 bytes} [Tue Jan 18 16:24:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:24:53.439946 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi [None req-0b06dc5e-3b7a-4195-95b1-4a932ea71100 admin admin] Calling method '>' {{(pid=101725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:24:53.459800 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: INFO nova.api.openstack.requestlog [None req-0b06dc5e-3b7a-4195-95b1-4a932ea71100 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071251 Jan 18 16:24:53.460360 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: [pid: 101725|app: 0|req: 33/64] 10.222.0.82 () {60 vars in 1291 bytes} [Tue Jan 18 16:24:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:24:53.482605 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-bfd30c3f-2a8d-431a-8219-67e36a9a37fa admin admin] Calling method '>' {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:24:53.491200 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-bfd30c3f-2a8d-431a-8219-67e36a9a37fa admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011262 Jan 18 16:24:53.491768 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 32/65] 10.222.0.82 () {60 vars in 1282 bytes} [Tue Jan 18 16:24:53 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:24:53.502800 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi [None req-eb069d0a-87a4-4ed8-a8fc-25a1e0afe65e admin admin] Calling method '>' {{(pid=101725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:24:53.510586 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: INFO nova.api.openstack.requestlog [None req-eb069d0a-87a4-4ed8-a8fc-25a1e0afe65e admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011263 Jan 18 16:24:53.511093 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: [pid: 101725|app: 0|req: 34/66] 10.222.0.82 () {60 vars in 1285 bytes} [Tue Jan 18 16:24:53 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:24:53.522036 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-2bc372e1-732f-4a1b-99be-c6541c441ef1 admin admin] Calling method '>' {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:24:53.529435 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-2bc372e1-732f-4a1b-99be-c6541c441ef1 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011013 Jan 18 16:24:53.529939 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 33/67] 10.222.0.82 () {60 vars in 1285 bytes} [Tue Jan 18 16:24:53 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:24:53.541230 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi [None req-46d2824b-d110-476d-9583-e832608aac6f admin admin] Calling method '>' {{(pid=101725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:24:53.548557 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: INFO nova.api.openstack.requestlog [None req-46d2824b-d110-476d-9583-e832608aac6f admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011469 Jan 18 16:24:53.549129 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: [pid: 101725|app: 0|req: 35/68] 10.222.0.82 () {60 vars in 1282 bytes} [Tue Jan 18 16:24:53 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:26:19.804395 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-620323c2-c879-44e1-9d1d-dc3341a10fc0 tempest-verify_tempest_config-1699455668 tempest-verify_tempest_config-1699455668-project] Calling method '>' {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:26:19.806403 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-620323c2-c879-44e1-9d1d-dc3341a10fc0 tempest-verify_tempest_config-1699455668 tempest-verify_tempest_config-1699455668-project] 10.222.0.82 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.107564 Jan 18 16:26:19.806933 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 34/69] 10.222.0.82 () {58 vars in 1133 bytes} [Tue Jan 18 16:26:19 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:27:54.681348 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi [None req-46d2824b-d110-476d-9583-e832608aac6f admin admin] Calling method '>' {{(pid=101725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:27:54.682470 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: INFO nova.api.openstack.requestlog [None req-46d2824b-d110-476d-9583-e832608aac6f admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 Jan 18 16:27:54.682917 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: [pid: 101725|app: 0|req: 36/70] 10.222.0.82 () {56 vars in 1074 bytes} [Tue Jan 18 16:27:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:27:54.948564 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-e89c41bb-c4e0-412b-a32d-5bb3dfa7c98a admin admin] Calling method '>' {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:27:54.949763 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:27:54.949763 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: warnings.warn(msg) Jan 18 16:27:54.951541 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG oslo_concurrency.lockutils [None req-e89c41bb-c4e0-412b-a32d-5bb3dfa7c98a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:27:54.951995 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG oslo_concurrency.lockutils [None req-e89c41bb-c4e0-412b-a32d-5bb3dfa7c98a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:27:54.952841 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG oslo_concurrency.lockutils [None req-e89c41bb-c4e0-412b-a32d-5bb3dfa7c98a admin admin] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:27:54.953244 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG oslo_concurrency.lockutils [None req-e89c41bb-c4e0-412b-a32d-5bb3dfa7c98a admin admin] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:27:54.987360 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-e89c41bb-c4e0-412b-a32d-5bb3dfa7c98a admin admin] 10.222.0.82 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.157756 Jan 18 16:27:54.987934 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 35/71] 10.222.0.82 () {60 vars in 1193 bytes} [Tue Jan 18 16:27:54 2022] GET /compute/v2.1/os-services => generated 791 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:27:56.271363 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi [None req-46d2824b-d110-476d-9583-e832608aac6f admin admin] Calling method '>' {{(pid=101725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:27:56.272370 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: INFO nova.api.openstack.requestlog [None req-46d2824b-d110-476d-9583-e832608aac6f admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 Jan 18 16:27:56.272761 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: [pid: 101725|app: 0|req: 37/72] 10.222.0.82 () {56 vars in 1074 bytes} [Tue Jan 18 16:27:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:27:56.468640 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-20fbe032-683d-4a47-96fd-c308181b92c1 admin admin] Calling method '>' {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:27:56.469833 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:27:56.469833 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: warnings.warn(msg) Jan 18 16:27:56.472006 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG oslo_concurrency.lockutils [None req-20fbe032-683d-4a47-96fd-c308181b92c1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:27:56.472438 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG oslo_concurrency.lockutils [None req-20fbe032-683d-4a47-96fd-c308181b92c1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:27:56.473295 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG oslo_concurrency.lockutils [None req-20fbe032-683d-4a47-96fd-c308181b92c1 admin admin] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:27:56.473718 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG oslo_concurrency.lockutils [None req-20fbe032-683d-4a47-96fd-c308181b92c1 admin admin] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:27:56.492964 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-20fbe032-683d-4a47-96fd-c308181b92c1 admin admin] 10.222.0.82 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075087 Jan 18 16:27:56.493523 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 36/73] 10.222.0.82 () {60 vars in 1193 bytes} [Tue Jan 18 16:27:56 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:28:08.162371 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi [None req-46d2824b-d110-476d-9583-e832608aac6f admin admin] Calling method '>' {{(pid=101725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:28:08.163368 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: INFO nova.api.openstack.requestlog [None req-46d2824b-d110-476d-9583-e832608aac6f admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Jan 18 16:28:08.163764 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: [pid: 101725|app: 0|req: 38/74] 10.222.0.82 () {56 vars in 1074 bytes} [Tue Jan 18 16:28:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:28:08.358106 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-54142b6b-2e16-4dee-972d-eb3d9c10c64b admin admin] Calling method '>' {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:28:08.359279 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:28:08.359279 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: warnings.warn(msg) Jan 18 16:28:08.360810 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG oslo_concurrency.lockutils [None req-54142b6b-2e16-4dee-972d-eb3d9c10c64b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:28:08.361853 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG oslo_concurrency.lockutils [None req-54142b6b-2e16-4dee-972d-eb3d9c10c64b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:28:08.362680 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG oslo_concurrency.lockutils [None req-54142b6b-2e16-4dee-972d-eb3d9c10c64b admin admin] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:28:08.363115 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG oslo_concurrency.lockutils [None req-54142b6b-2e16-4dee-972d-eb3d9c10c64b admin admin] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:28:08.387912 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-54142b6b-2e16-4dee-972d-eb3d9c10c64b admin admin] 10.222.0.82 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.081539 Jan 18 16:28:08.388392 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 37/75] 10.222.0.82 () {60 vars in 1193 bytes} [Tue Jan 18 16:28:08 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:28:09.678601 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: DEBUG nova.api.openstack.wsgi [None req-46d2824b-d110-476d-9583-e832608aac6f admin admin] Calling method '>' {{(pid=101725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:28:09.679655 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: INFO nova.api.openstack.requestlog [None req-46d2824b-d110-476d-9583-e832608aac6f admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jan 18 16:28:09.680054 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: [pid: 101725|app: 0|req: 39/76] 10.222.0.82 () {56 vars in 1074 bytes} [Tue Jan 18 16:28:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:28:09.873689 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-33c0d226-d0d8-4d81-ab1b-c475ffbda693 admin admin] Calling method '>' {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:28:09.874871 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:28:09.874871 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: warnings.warn(msg) Jan 18 16:28:09.876394 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG oslo_concurrency.lockutils [None req-33c0d226-d0d8-4d81-ab1b-c475ffbda693 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:28:09.877086 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG oslo_concurrency.lockutils [None req-33c0d226-d0d8-4d81-ab1b-c475ffbda693 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:28:09.877930 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG oslo_concurrency.lockutils [None req-33c0d226-d0d8-4d81-ab1b-c475ffbda693 admin admin] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:28:09.878353 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: DEBUG oslo_concurrency.lockutils [None req-33c0d226-d0d8-4d81-ab1b-c475ffbda693 admin admin] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:28:09.898920 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-33c0d226-d0d8-4d81-ab1b-c475ffbda693 admin admin] 10.222.0.82 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.076070 Jan 18 16:28:09.899395 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 38/77] 10.222.0.82 () {60 vars in 1193 bytes} [Tue Jan 18 16:28:09 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:29:10.096072 dv-cinder-788368-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jan 18 16:29:10.096639 dv-cinder-788368-3-iscsi devstack@n-api.service[101724]: Tue Jan 18 16:29:10 2022 - graceful shutdown triggered... Jan 18 16:29:10.097712 dv-cinder-788368-3-iscsi devstack@n-api.service[101725]: Gracefully killing worker 1 (pid: 101725)... Jan 18 16:29:10.099196 dv-cinder-788368-3-iscsi devstack@n-api.service[101726]: Gracefully killing worker 2 (pid: 101726)... Jan 18 16:29:11.097514 dv-cinder-788368-3-iscsi devstack@n-api.service[101724]: worker 1 buried after 1 seconds Jan 18 16:29:11.098073 dv-cinder-788368-3-iscsi devstack@n-api.service[101724]: worker 2 buried after 1 seconds Jan 18 16:29:11.098073 dv-cinder-788368-3-iscsi devstack@n-api.service[101724]: goodbye to uWSGI. Jan 18 16:29:11.099051 dv-cinder-788368-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jan 18 16:29:11.099594 dv-cinder-788368-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jan 18 16:29:11.102337 dv-cinder-788368-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 18 16:29:11.111716 dv-cinder-788368-3-iscsi devstack@n-api.service[116352]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 18 16:29:11.113899 dv-cinder-788368-3-iscsi devstack@n-api.service[116352]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jan 18 16:29:11 2022] *** Jan 18 16:29:11.113899 dv-cinder-788368-3-iscsi devstack@n-api.service[116352]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 18 16:29:11.113899 dv-cinder-788368-3-iscsi devstack@n-api.service[116352]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 18 16:29:11.113899 dv-cinder-788368-3-iscsi devstack@n-api.service[116352]: nodename: dv-cinder-788368-3-iscsi Jan 18 16:29:11.113899 dv-cinder-788368-3-iscsi devstack@n-api.service[116352]: machine: x86_64 Jan 18 16:29:11.113899 dv-cinder-788368-3-iscsi devstack@n-api.service[116352]: clock source: unix Jan 18 16:29:11.113899 dv-cinder-788368-3-iscsi devstack@n-api.service[116352]: pcre jit disabled Jan 18 16:29:11.113899 dv-cinder-788368-3-iscsi devstack@n-api.service[116352]: detected number of CPU cores: 4 Jan 18 16:29:11.113899 dv-cinder-788368-3-iscsi devstack@n-api.service[116352]: current working directory: / Jan 18 16:29:11.113899 dv-cinder-788368-3-iscsi devstack@n-api.service[116352]: detected binary path: /usr/bin/uwsgi-core Jan 18 16:29:11.113899 dv-cinder-788368-3-iscsi devstack@n-api.service[116352]: your processes number limit is 47680 Jan 18 16:29:11.113899 dv-cinder-788368-3-iscsi devstack@n-api.service[116352]: your memory page size is 4096 bytes Jan 18 16:29:11.113899 dv-cinder-788368-3-iscsi devstack@n-api.service[116352]: detected max file descriptor number: 2048 Jan 18 16:29:11.113899 dv-cinder-788368-3-iscsi devstack@n-api.service[116352]: lock engine: pthread robust mutexes Jan 18 16:29:11.114874 dv-cinder-788368-3-iscsi devstack@n-api.service[116352]: thunder lock: enabled Jan 18 16:29:11.114874 dv-cinder-788368-3-iscsi devstack@n-api.service[116352]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 18 16:29:11.114874 dv-cinder-788368-3-iscsi devstack@n-api.service[116352]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 18 16:29:11.160289 dv-cinder-788368-3-iscsi devstack@n-api.service[116352]: Python main interpreter initialized at 0x55a9cb88c9c0 Jan 18 16:29:11.160289 dv-cinder-788368-3-iscsi devstack@n-api.service[116352]: python threads support enabled Jan 18 16:29:11.160289 dv-cinder-788368-3-iscsi devstack@n-api.service[116352]: your server socket listen backlog is limited to 100 connections Jan 18 16:29:11.160289 dv-cinder-788368-3-iscsi devstack@n-api.service[116352]: your mercy for graceful operations on workers is 90 seconds Jan 18 16:29:11.160749 dv-cinder-788368-3-iscsi devstack@n-api.service[116352]: mapped 403077 bytes (393 KB) for 2 cores Jan 18 16:29:11.160749 dv-cinder-788368-3-iscsi devstack@n-api.service[116352]: *** Operational MODE: preforking *** Jan 18 16:29:11.160913 dv-cinder-788368-3-iscsi devstack@n-api.service[116352]: *** uWSGI is running in multiple interpreter mode *** Jan 18 16:29:11.160913 dv-cinder-788368-3-iscsi devstack@n-api.service[116352]: spawned uWSGI master process (pid: 116352) Jan 18 16:29:11.161018 dv-cinder-788368-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 18 16:29:11.162181 dv-cinder-788368-3-iscsi devstack@n-api.service[116352]: spawned uWSGI worker 1 (pid: 116367, cores: 1) Jan 18 16:29:11.162181 dv-cinder-788368-3-iscsi devstack@n-api.service[116352]: spawned uWSGI worker 2 (pid: 116368, cores: 1) Jan 18 16:29:11.162181 dv-cinder-788368-3-iscsi devstack@n-api.service[116352]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 18 16:29:13.113551 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 18 16:29:13.113551 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: from cryptography.utils import int_from_bytes Jan 18 16:29:13.114321 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 18 16:29:13.114321 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: from cryptography.utils import int_from_bytes Jan 18 16:29:13.114488 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 18 16:29:13.114488 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: from cryptography.utils import int_from_bytes Jan 18 16:29:13.114488 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 18 16:29:13.114488 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: from cryptography.utils import int_from_bytes Jan 18 16:29:15.599817 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 18 16:29:15.600507 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 18 16:29:15.600507 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 18 16:29:15.600884 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 18 16:29:15.601184 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 18 16:29:15.601593 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.601938 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.602268 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.602608 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.602956 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.603282 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.603625 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.603965 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.604313 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.604581 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.604937 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.605282 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-788368-3-iscsi {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.605623 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.605941 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.606341 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.606687 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.607012 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.607367 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.607681 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.608205 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.609627 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.609627 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.609627 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.610011 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.610232 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 18 16:29:15.610635 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.610722 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 18 16:29:15.610807 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.611041 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.611275 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 18 16:29:15.611524 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.611759 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 18 16:29:15.611977 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.612208 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 18 16:29:15.612428 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.613125 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.613378 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-788368-3-iscsi {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.613608 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.613834 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.614060 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.614060 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.614501 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.614728 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.614958 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.615184 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.615452 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.615775 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.615990 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.616207 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.616564 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.616754 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.616968 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.617133 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.617295 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.617655 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.618273 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.618577 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-788368-3-iscsi {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.618734 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.618965 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.619654 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.619961 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.620265 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.620439 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.620593 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.620798 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.621004 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.621199 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.621357 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.621507 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.621705 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.622189 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.623364 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.623542 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.623724 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.623997 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.624157 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.624326 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.624470 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.624625 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.624779 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.624779 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.625134 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.625287 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.625447 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.625589 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.625820 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.625977 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.626133 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.626321 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.626589 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.626810 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.627026 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.627241 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.627436 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.627668 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.627812 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-788368-3-iscsi {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.627965 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.628120 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.628790 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.628969 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.629267 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.629839 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.629990 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.629990 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.630268 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.630422 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.630574 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.630721 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.630868 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.631017 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.631232 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.631489 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.631734 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.631982 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.632218 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.632459 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.633493 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.633660 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.633813 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.633813 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.634100 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.82 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.634100 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.82 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.634397 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.634548 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.634699 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.634699 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.634987 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.635135 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.635293 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.635293 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.635689 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.635689 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.635989 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.636186 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.636347 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.636491 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.636631 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.636772 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.636772 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.637099 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.637253 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.637401 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.637548 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.637698 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.637846 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.637846 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.638138 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.638284 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.638433 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.638433 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.638735 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.638895 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.639047 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.639189 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.639338 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.639487 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.639642 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.639791 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.639939 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.640091 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.640240 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.640381 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.640681 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.640893 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.641118 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.641295 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.641492 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.641667 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.641863 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.642060 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.642307 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.642553 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.643644 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.644547 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.644739 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.644932 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.645087 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.645268 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.645471 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.82 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.645642 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.645870 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.82 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.646121 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.646328 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.646480 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.646633 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.646777 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.646926 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.647079 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.647240 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.647381 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.647536 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.647679 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.647827 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.647976 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.648119 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.648273 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.648421 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.648570 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.648845 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.649163 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.649326 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.649487 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.649636 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.649785 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.649937 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.650088 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.650231 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.650380 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.650574 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.650864 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.651411 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.651574 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.651782 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.651995 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.652155 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.652307 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.652458 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.652608 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.652758 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.653159 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.653833 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.654012 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.654284 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.654442 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.654592 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.654740 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.654894 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.655043 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.655202 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.655351 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.656108 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.656269 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.656412 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.656412 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.656715 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.656884 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.657109 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.657255 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.657398 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.657398 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.657655 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.657764 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.657839 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.657909 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.657979 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.658059 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.658131 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.658209 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.658280 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.658356 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.658435 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.658519 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.658591 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.658674 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.658764 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.658847 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.658926 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.658998 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.659078 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.659078 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.659078 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.659078 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.659078 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.659078 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.659078 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.659078 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.659644 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.659644 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.659644 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.659857 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.659942 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.660014 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.660091 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.660171 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.660250 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.660250 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.660387 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.660458 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.660527 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.660604 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.660676 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.660752 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.660839 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.660911 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.661008 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.661079 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.661079 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.661257 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.661411 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.661559 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.661691 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.661828 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.661966 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.662123 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.662272 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 16:29:15.662426 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.662577 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.662721 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.662867 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.662961 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.663060 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.663133 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.663210 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.663289 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.663360 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.663445 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.663517 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.663587 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.663663 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.663742 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.663822 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.663907 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.663987 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.664074 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.664147 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.664147 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.664281 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.664358 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.664358 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.664495 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.664495 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.664635 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.664714 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.664802 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.664882 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.664987 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.665062 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.665140 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.665219 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.665300 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.665379 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.665450 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.665532 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.665609 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.665681 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.665763 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.665842 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.665920 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.665997 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.666068 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.666144 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.666294 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.666376 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.666447 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.666524 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.666595 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.666680 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.666752 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.666821 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.666889 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.666958 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.667027 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.667027 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.667168 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.667244 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.667244 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.667383 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.667453 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.667535 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.669153 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.669346 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.669509 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.669667 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.669821 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.669978 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.670126 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.670126 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.670415 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.670559 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.670721 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.670876 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.671030 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.671177 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.671177 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.671468 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.671640 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.671788 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.671933 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.672079 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.672250 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.672405 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.672559 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.672705 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.672858 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.673057 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.673215 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.673369 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.673524 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.673671 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.673823 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.673968 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.674133 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.674295 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.674448 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.674593 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.674745 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.674891 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.675076 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.675237 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.675386 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.675532 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.675684 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.675831 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.675976 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.676140 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.676286 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.676286 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.676563 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.676716 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.676716 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.677032 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.677181 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.677337 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.677492 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.677648 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.677810 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.677967 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.678134 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.678281 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.678426 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.678579 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.678733 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.678880 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.679025 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.679177 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.679329 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.679482 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.679642 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.679794 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.679974 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.680154 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.680330 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.681856 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.681856 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.682181 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.682329 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.682484 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.682641 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.682797 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.682945 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.683392 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.683568 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.683760 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.683909 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.684372 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.684627 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.684878 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.685144 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.685346 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.685510 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.685687 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.685862 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.686018 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.686165 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.686344 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.686601 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.686601 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.687106 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.687106 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.687453 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.687453 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.687827 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.687988 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.688147 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.688303 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.688458 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.688604 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.688604 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.688912 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.689092 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.689246 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.689400 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.689552 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.689708 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.689866 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.690071 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.690071 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.690500 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.690500 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.691585 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.691585 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.692304 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.692461 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.692627 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.692800 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.692800 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.693119 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.693266 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.693266 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.693593 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.693762 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.693915 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.694077 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.694239 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.694412 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.694601 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.694764 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.694925 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.695086 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.695269 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.695459 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.695673 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.695840 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.695994 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.696145 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.696297 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.696459 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.696619 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.696787 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.696990 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.696990 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.697308 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.697308 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.697604 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.697770 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.697923 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.698073 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.698224 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.698395 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.698779 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.698948 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.699109 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.699260 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.699421 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.699572 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.699814 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.699977 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.700141 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.700301 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.700454 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.700613 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.700830 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.701184 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.701360 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.701524 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.701677 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.701829 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.701990 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.702150 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.702308 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.702461 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.702613 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.702774 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.702935 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.703095 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.703259 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.703419 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.703572 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.703739 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.703891 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.704043 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.704203 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.704355 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.704355 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.704662 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.704815 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.705012 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.705179 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.705350 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.705512 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.705674 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.705855 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.706010 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.706179 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.706179 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.707162 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.707162 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.707464 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.707616 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.707777 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.707777 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.708097 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.708260 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.708421 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.708421 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.708719 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.708719 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.709059 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.709221 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.709381 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.709381 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.709684 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.709684 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.710057 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.710223 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.710376 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.710376 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.710673 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.710837 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.710837 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.711144 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.711297 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.711448 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.711598 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.711758 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.711918 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.712082 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.712233 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.712233 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.712520 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.712753 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.712753 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.713153 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.713306 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.713467 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.713626 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.713804 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.713959 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.714112 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.714282 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.714282 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.714582 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.714734 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.714734 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.715028 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.715180 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.715180 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.715478 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.715638 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.715798 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.715950 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.715950 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.716264 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.716431 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.716431 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.716755 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.716941 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.716941 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.717248 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.717414 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.717573 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.717725 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.717725 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.718093 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.718276 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.718276 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.718575 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.718735 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.718735 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.719032 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.719283 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.719540 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.719834 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.720082 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.720282 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.720282 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.720598 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.720598 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.720908 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.721108 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.721261 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.721424 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.721424 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.721734 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.721939 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.722135 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.722297 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.722469 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.722623 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.722773 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.722936 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.723087 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.723238 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.723399 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.723561 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.723713 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.723941 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.724095 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.724245 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.724436 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.724596 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.724770 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.725034 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.725194 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.725358 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.725521 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.725675 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.726555 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.726726 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.726882 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.727042 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.727203 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.727356 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.727521 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.727694 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.727857 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.728018 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.728018 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.728318 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.728318 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.728721 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.728877 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.729082 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.729248 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.729248 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.729546 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.729706 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.729706 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.730102 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.730354 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.730354 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.730829 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.731089 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.731366 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.731626 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.731889 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.732138 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.732307 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.732470 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.732655 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.732824 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.733028 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.733195 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.733349 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.733510 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.733664 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.733815 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.733967 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.734120 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.734120 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.734431 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.734624 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.734851 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.735034 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.735197 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.735351 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.735516 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.735671 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.735902 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.736170 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.736435 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.736813 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.737153 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.737420 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.737723 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.737967 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.738187 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.738431 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.738431 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.738874 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.739112 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.739112 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.739585 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.739843 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.740106 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.740298 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.740298 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.740609 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.740783 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.740966 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.741137 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.741300 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.741455 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.741455 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.741754 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.741906 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.742065 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.742208 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.742208 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.742531 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.742801 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.743069 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.743331 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.743331 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.743968 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.744154 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.744388 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.744493 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.744493 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.744667 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.744753 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.744753 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.744960 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.745050 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.745165 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.745316 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.745316 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.745649 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.745826 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.745826 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.746145 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.746243 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.746329 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.746430 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.746430 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.746590 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.746791 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.746791 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.747078 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.747253 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.747412 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.747568 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.747568 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.747840 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.747997 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.747997 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.748266 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.748503 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.748646 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.748646 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.749099 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.749247 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.749385 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.749535 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.749694 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.749847 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.750120 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.750289 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.750482 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.750711 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.750875 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.751166 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.751333 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.751473 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.751754 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.751909 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.752111 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.752241 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.752455 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.752748 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.753098 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.753915 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.754149 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.754509 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.754658 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.754862 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.755007 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.755190 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.755332 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.755522 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.755657 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.755846 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.756007 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.756164 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.756299 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.756491 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.756633 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.756818 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.757029 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.757171 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.757308 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.757479 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.757616 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.757807 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.757943 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.758131 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.758277 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.758447 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.758579 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.758767 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.758933 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.759131 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.759280 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.759446 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.759581 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.759768 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.759904 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.760122 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.760284 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.760446 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.760581 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.760881 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.761115 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.761333 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.761563 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.761796 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.762010 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.762242 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.762475 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.762710 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.762854 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.762996 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.763128 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.763268 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.763409 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.763633 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.763767 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.763898 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.764028 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.764028 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.764284 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.764425 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.764574 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.764849 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.765053 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.765185 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.765314 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.765444 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.765568 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.765682 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.765871 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.766271 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.766573 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.766985 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.767112 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.767391 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.767737 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.768105 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.768246 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.768445 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.768574 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.769568 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.769752 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.769951 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.770139 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.770451 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.770615 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.770783 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.771108 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.771332 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.771675 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.771910 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.772076 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.772371 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.772643 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.772949 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.773270 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.773434 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.773594 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.773744 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.773894 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.774059 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.774481 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.774670 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.775005 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.775171 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.775330 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.775503 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.775661 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.775802 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.775961 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.776117 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.776264 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.776423 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.776579 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.776725 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.776877 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.777093 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.777241 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.778052 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.778206 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.778351 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.778351 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.781657 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.782277 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.782430 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.782430 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.782739 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.782739 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.783026 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.783026 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.783325 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.783325 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.783601 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.784060 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.784235 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.784423 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.784423 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.785096 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.785253 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.785464 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.785655 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.785803 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.785803 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.786100 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.786100 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.786924 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.787095 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.787246 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.787409 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.787566 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.787725 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.787889 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.788064 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.788228 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.788434 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.788599 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.788747 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.788893 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.789066 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.789226 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.789396 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.789546 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.789713 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.789900 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.790064 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.790243 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.790416 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.790572 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.790758 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.790906 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.790906 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.791191 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.791346 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.791492 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.791872 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.792107 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.792384 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.792632 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.792867 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.793199 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.793467 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.793711 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.793981 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.794216 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.794478 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.794732 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.795121 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.795381 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.795668 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.795930 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.796189 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.796434 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.796798 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.797084 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.797190 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.797276 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.797371 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.797464 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.797559 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.797652 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.797746 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.797829 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.797900 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.797969 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.798048 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.798048 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.798198 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.798298 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.798384 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.798455 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.798533 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.798639 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.798724 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.798805 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.798965 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.799063 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.799063 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.799203 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.799305 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.799386 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.799467 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.799558 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.799650 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.799741 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.799824 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.799906 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.800018 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.800121 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.800211 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.800301 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.800392 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.800483 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.800565 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.800657 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.800748 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.800831 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.800902 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.801078 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.801318 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.801408 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.801480 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.801570 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.801653 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.801751 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.801921 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.802023 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.802114 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.802211 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.802295 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.802384 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.802475 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.802565 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.802666 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.802737 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.802815 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.802893 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.803028 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.803028 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.803214 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.803305 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.803387 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.803477 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.803561 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.803642 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.803746 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.803844 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.803927 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.804017 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.804101 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.804209 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.804301 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.804384 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.804473 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.804566 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.804649 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.804729 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.804810 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.804910 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.805021 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.805021 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.805172 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.805669 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.805770 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.805855 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.805937 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.806188 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.806366 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.806502 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.806613 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.807009 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.807151 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.807265 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.807384 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.807497 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.807615 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.807725 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.807849 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.808081 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.808242 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.808501 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.808836 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.809193 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.809560 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.809762 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.809926 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.810088 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.810249 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.810422 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.810587 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.810897 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.810897 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.811199 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.811359 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.811523 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.811678 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.811829 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.812000 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.812154 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.812306 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.812473 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.812627 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.812779 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.812961 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.813138 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.813291 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.813452 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.813605 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.813758 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.813929 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.814090 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.814252 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.814417 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.814578 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.814740 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.814893 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.815056 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.815319 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.815481 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.816397 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.816583 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.816741 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.816911 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.817108 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.817270 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.817431 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.817591 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.817748 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.817912 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.818066 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.818216 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.818380 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.818533 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.818698 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.818876 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.819039 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.819191 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.819355 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.819508 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.819669 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.819822 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.819975 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.820126 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.820277 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.820427 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.820592 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.820762 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.820914 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.821113 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.821274 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.821436 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.821654 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.821817 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.821971 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.822131 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.822282 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.822434 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.822598 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.822759 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.822934 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.823087 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.823246 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.823407 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.823561 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.823720 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.823892 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.824063 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.824218 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.824397 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.824551 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.824721 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.824894 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.825074 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.825242 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.825488 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.825657 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.825812 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.825964 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.826116 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.826278 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.826439 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.826601 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.826754 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.826917 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.827077 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.827244 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.827398 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.827567 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.827719 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.827898 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.828060 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.828233 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.828395 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.828554 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.828715 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.828879 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.829099 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.829263 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.829430 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.829602 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.829756 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.829908 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.830068 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.830229 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.830382 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.830534 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.830687 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.830848 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.831011 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.831171 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.832027 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.832203 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.832357 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.832357 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.832670 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.832670 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.832991 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.833151 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.833311 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.833474 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.833641 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.833802 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.833956 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.834116 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.834269 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.834434 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.834596 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.834757 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.834910 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.835061 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.835228 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.835387 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.835648 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.835830 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.835994 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.836147 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.836313 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.836475 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.836630 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.836784 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.837036 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.837198 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.837370 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.837535 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.837698 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.837919 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.838100 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.838262 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.838426 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.838588 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.838741 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.838901 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.839062 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.839223 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.839385 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.839544 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.839697 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.839856 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.840017 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.840194 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.840356 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.840510 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.840670 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.840823 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.841011 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.841218 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.841384 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.841539 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.841698 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.841857 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.842017 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.842189 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.842354 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.842507 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.842658 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.842810 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.842974 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.843127 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.843287 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.843448 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.843609 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.843761 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.843921 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.844074 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.844236 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.844396 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.844557 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.844718 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.844884 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.845104 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.845258 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.845411 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.845575 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.845831 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.846001 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.846154 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.846316 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.846480 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.846632 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.846801 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.846995 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.847150 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.847449 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.847811 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.847983 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.848185 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.848341 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.848493 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.848644 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.848907 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.849112 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.849286 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.849442 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.849602 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.849762 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.849956 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.850126 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.850296 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.850459 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.850621 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.850775 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.850934 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.851106 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.851268 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.851429 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.851583 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.851735 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.851895 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.851895 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.852202 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.852361 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.852523 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.852676 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.852834 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.853088 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.853259 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.853413 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.853574 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.853735 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.853902 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.854055 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.854207 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.854359 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.854511 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.854672 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.854838 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.854991 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.855151 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.855321 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.855484 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.855645 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.855899 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.856129 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.856288 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.856288 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.856587 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.856743 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.856905 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.857095 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.857251 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.857414 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.857585 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.857749 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.857944 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.858099 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.858252 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.858412 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.858564 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.858727 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.858889 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.859042 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.859194 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.859346 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.859515 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.859679 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.859841 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.860002 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.860155 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.860320 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.860487 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.860641 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.860801 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.860992 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.861151 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.861314 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.861487 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.861642 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.861801 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.861955 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.862106 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.862259 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.862421 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.863123 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.863284 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.863453 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.863614 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.863614 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.864034 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.864207 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.864369 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.864523 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.864682 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.864844 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.865019 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.865186 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.865339 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.865493 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.865653 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.865820 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.865973 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.866162 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.866392 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.866560 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.866721 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.866892 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.867045 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.867199 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.867359 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.867512 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.867677 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.867847 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.868010 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.868175 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.868330 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.868491 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.868652 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.868805 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.869018 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.869178 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.869339 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.869501 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.869695 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.869852 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.870004 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.870157 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.870157 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.870482 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.870636 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.870798 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.870958 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.871118 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.871360 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.871611 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.871873 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.872137 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.872404 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.872614 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.872793 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.872998 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.873160 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.873160 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.873506 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.873776 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.873776 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.874292 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.874292 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.874654 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.874810 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.874962 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.874962 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.875298 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.875462 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.875462 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.875769 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.875940 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.876103 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.876257 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.876257 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.876658 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.876826 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.877033 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.877202 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.877368 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.877521 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.877673 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.877836 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.878074 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.878823 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.879078 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 18 16:29:15.879247 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.879787 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.880339 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.880892 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.881547 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.882034 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.882230 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.882572 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.882910 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.883246 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.883579 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.883931 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.884277 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.884602 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.884966 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.885306 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.885648 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.885983 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.886377 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.886724 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.887054 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.887389 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.887718 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.888046 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.888381 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.888713 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.889091 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.889466 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.889806 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.890627 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.890627 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.890970 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.891295 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.891640 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.891971 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.892299 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.892620 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 16:29:15.892876 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 18 16:29:15.913194 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_db.sqlalchemy.engines [None req-48880136-d70e-4686-a5bf-a96851f6ad3d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116368) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 18 16:29:15.917956 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_db.sqlalchemy.engines [None req-192292b6-a10d-4e06-b28a-51eb2dd6a90d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116367) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 18 16:29:15.986922 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.context [None req-48880136-d70e-4686-a5bf-a96851f6ad3d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),893648b7-9c61-4bb4-8054-545f5288e2ec(cell1) {{(pid=116368) load_cells /opt/stack/nova/nova/context.py:464}} Jan 18 16:29:15.987285 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.context [None req-192292b6-a10d-4e06-b28a-51eb2dd6a90d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),893648b7-9c61-4bb4-8054-545f5288e2ec(cell1) {{(pid=116367) load_cells /opt/stack/nova/nova/context.py:464}} Jan 18 16:29:15.991808 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-48880136-d70e-4686-a5bf-a96851f6ad3d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:29:15.993449 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-48880136-d70e-4686-a5bf-a96851f6ad3d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:29:15.994294 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-48880136-d70e-4686-a5bf-a96851f6ad3d None None] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:29:15.994426 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-192292b6-a10d-4e06-b28a-51eb2dd6a90d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:29:15.996008 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-192292b6-a10d-4e06-b28a-51eb2dd6a90d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:29:15.996229 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-48880136-d70e-4686-a5bf-a96851f6ad3d None None] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:29:15.996857 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-192292b6-a10d-4e06-b28a-51eb2dd6a90d None None] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:29:15.998839 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-192292b6-a10d-4e06-b28a-51eb2dd6a90d None None] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:29:16.009332 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_db.sqlalchemy.engines [None req-48880136-d70e-4686-a5bf-a96851f6ad3d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116368) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 18 16:29:16.010193 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_db.sqlalchemy.engines [None req-48880136-d70e-4686-a5bf-a96851f6ad3d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116368) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 18 16:29:16.012375 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_db.sqlalchemy.engines [None req-192292b6-a10d-4e06-b28a-51eb2dd6a90d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116367) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 18 16:29:16.022224 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_db.sqlalchemy.engines [None req-192292b6-a10d-4e06-b28a-51eb2dd6a90d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116367) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 18 16:29:16.186791 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_db.sqlalchemy.engines [None req-192292b6-a10d-4e06-b28a-51eb2dd6a90d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116367) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 18 16:29:16.190224 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_db.sqlalchemy.engines [None req-48880136-d70e-4686-a5bf-a96851f6ad3d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116368) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 18 16:29:16.513998 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: WARNING keystonemiddleware.auth_token [None req-192292b6-a10d-4e06-b28a-51eb2dd6a90d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 18 16:29:16.518574 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: WARNING keystonemiddleware.auth_token [None req-48880136-d70e-4686-a5bf-a96851f6ad3d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 18 16:29:16.520670 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: WARNING keystonemiddleware.auth_token [None req-192292b6-a10d-4e06-b28a-51eb2dd6a90d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 18 16:29:16.525668 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: WARNING keystonemiddleware.auth_token [None req-48880136-d70e-4686-a5bf-a96851f6ad3d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 18 16:29:16.874709 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: WARNING keystonemiddleware.auth_token [None req-48880136-d70e-4686-a5bf-a96851f6ad3d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 18 16:29:16.876429 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: WARNING keystonemiddleware.auth_token [None req-192292b6-a10d-4e06-b28a-51eb2dd6a90d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 18 16:29:16.880506 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: WARNING keystonemiddleware.auth_token [None req-48880136-d70e-4686-a5bf-a96851f6ad3d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 18 16:29:16.881964 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: WARNING keystonemiddleware.auth_token [None req-192292b6-a10d-4e06-b28a-51eb2dd6a90d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 18 16:29:16.886009 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a9cb88c9c0 pid: 116368 (default app) Jan 18 16:29:16.887396 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a9cb88c9c0 pid: 116367 (default app) Jan 18 16:29:52.992414 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-75db41eb-aa95-43d1-b69a-a498864c755c tempest-VolumesSnapshotsTestJSON-990929192 tempest-VolumesSnapshotsTestJSON-990929192-project] Action: 'create', calling method: .version_select at 0x7f33a6866dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1749122088"}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:29:53.130097 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-22e035e2-9a09-4912-b8a6-5b2036cc6c3f tempest-VolumesGetTestJSON-1948740035 tempest-VolumesGetTestJSON-1948740035-project] Action: 'create', calling method: .version_select at 0x7f33a6866dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2093355455", "metadata": {"Type": "work"}}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:29:53.990473 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-75db41eb-aa95-43d1-b69a-a498864c755c tempest-VolumesSnapshotsTestJSON-990929192 tempest-VolumesSnapshotsTestJSON-990929192-project] 10.222.0.82 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.531710 Jan 18 16:29:53.991455 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 1/1] 10.222.0.82 () {60 vars in 1154 bytes} [Tue Jan 18 16:29:51 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2535 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 18 16:29:54.021851 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-22e035e2-9a09-4912-b8a6-5b2036cc6c3f tempest-VolumesGetTestJSON-1948740035 tempest-VolumesGetTestJSON-1948740035-project] 10.222.0.82 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.853962 Jan 18 16:29:54.023023 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 1/2] 10.222.0.82 () {60 vars in 1155 bytes} [Tue Jan 18 16:29:52 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1857 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 18 16:29:54.031737 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-533f6e92-2586-49b8-a24e-386f8db3cf7c tempest-VolumesSnapshotsTestJSON-990929192 tempest-VolumesSnapshotsTestJSON-990929192-project] Calling method '.version_select at 0x7f33a6737940>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:29:54.219677 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-533f6e92-2586-49b8-a24e-386f8db3cf7c tempest-VolumesSnapshotsTestJSON-990929192 tempest-VolumesSnapshotsTestJSON-990929192-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/54085779-5a99-4788-bcac-fb542e99f3fe" status: 200 len: 345 microversion: 2.1 time: 0.195227 Jan 18 16:29:54.220621 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 2/3] 10.222.0.82 () {58 vars in 1244 bytes} [Tue Jan 18 16:29:54 2022] GET /compute/v2.1/os-volumes/54085779-5a99-4788-bcac-fb542e99f3fe => generated 345 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:29:54.227208 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-9c73e8a3-e9db-41f9-96b8-77d0d4d82df7 tempest-VolumesGetTestJSON-1948740035 tempest-VolumesGetTestJSON-1948740035-project] Calling method '.version_select at 0x7f33a6737ee0>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:29:54.347250 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-9c73e8a3-e9db-41f9-96b8-77d0d4d82df7 tempest-VolumesGetTestJSON-1948740035 tempest-VolumesGetTestJSON-1948740035-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/4e9ef50a-c0db-48b9-bff8-1dae4ab5a455" status: 200 len: 353 microversion: 2.1 time: 0.124474 Jan 18 16:29:54.347815 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 3/4] 10.222.0.82 () {58 vars in 1244 bytes} [Tue Jan 18 16:29:54 2022] GET /compute/v2.1/os-volumes/4e9ef50a-c0db-48b9-bff8-1dae4ab5a455 => generated 353 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:29:54.416428 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-afd08a9c-f313-44a9-abff-a5f471e15285 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1269143827", "imageRef": "900c4a9d-b6c6-451f-a509-eb4f4b49f459", "flavorRef": "452", "networks": [{"uuid": "f411651e-6154-4773-b736-16dae1674cec"}]}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:29:54.598072 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.network.neutron [None req-afd08a9c-f313-44a9-abff-a5f471e15285 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] validate_networks() for [('f411651e-6154-4773-b736-16dae1674cec', None, None, None, None, None)] {{(pid=116368) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 18 16:29:55.238192 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-184cbc67-d9dc-4e9b-942b-8ee1551afb31 tempest-VolumesSnapshotsTestJSON-990929192 tempest-VolumesSnapshotsTestJSON-990929192-project] Calling method '.version_select at 0x7f33a674a280>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:29:55.358491 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-184cbc67-d9dc-4e9b-942b-8ee1551afb31 tempest-VolumesSnapshotsTestJSON-990929192 tempest-VolumesSnapshotsTestJSON-990929192-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/54085779-5a99-4788-bcac-fb542e99f3fe" status: 200 len: 346 microversion: 2.1 time: 0.126772 Jan 18 16:29:55.361298 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 4/5] 10.222.0.82 () {58 vars in 1244 bytes} [Tue Jan 18 16:29:55 2022] GET /compute/v2.1/os-volumes/54085779-5a99-4788-bcac-fb542e99f3fe => generated 346 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:29:55.389449 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-30c0ee8f-2b0b-4bfb-96c0-9988aee02c95 tempest-VolumesGetTestJSON-1948740035 tempest-VolumesGetTestJSON-1948740035-project] Calling method '.version_select at 0x7f33a674ab80>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:29:55.480128 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-30c0ee8f-2b0b-4bfb-96c0-9988aee02c95 tempest-VolumesGetTestJSON-1948740035 tempest-VolumesGetTestJSON-1948740035-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/4e9ef50a-c0db-48b9-bff8-1dae4ab5a455" status: 200 len: 354 microversion: 2.1 time: 0.116102 Jan 18 16:29:55.481791 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 5/6] 10.222.0.82 () {58 vars in 1244 bytes} [Tue Jan 18 16:29:55 2022] GET /compute/v2.1/os-volumes/4e9ef50a-c0db-48b9-bff8-1dae4ab5a455 => generated 354 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:29:55.487837 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-749be62a-bac6-4611-b7be-a8af18093156 tempest-VolumesSnapshotsTestJSON-990929192 tempest-VolumesSnapshotsTestJSON-990929192-project] Action: 'create', calling method: .version_select at 0x7f33a6866dc0>, body: {"snapshot": {"volume_id": "54085779-5a99-4788-bcac-fb542e99f3fe", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1699558614"}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:29:55.867408 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-749be62a-bac6-4611-b7be-a8af18093156 tempest-VolumesSnapshotsTestJSON-990929192 tempest-VolumesSnapshotsTestJSON-990929192-project] 10.222.0.82 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.384156 Jan 18 16:29:55.867987 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 6/7] 10.222.0.82 () {60 vars in 1161 bytes} [Tue Jan 18 16:29:55 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:29:55.875009 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-6e539ed5-e9b4-4676-8935-6f712a0b339b tempest-VolumesGetTestJSON-1948740035 tempest-VolumesGetTestJSON-1948740035-project] Calling method '.version_select at 0x7f33a674a280>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:29:55.983834 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-6e539ed5-e9b4-4676-8935-6f712a0b339b tempest-VolumesGetTestJSON-1948740035 tempest-VolumesGetTestJSON-1948740035-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/4e9ef50a-c0db-48b9-bff8-1dae4ab5a455" status: 200 len: 354 microversion: 2.1 time: 0.098284 Jan 18 16:29:56.024743 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 7/8] 10.222.0.82 () {58 vars in 1244 bytes} [Tue Jan 18 16:29:55 2022] GET /compute/v2.1/os-volumes/4e9ef50a-c0db-48b9-bff8-1dae4ab5a455 => generated 354 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:29:56.024743 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-b899e9ec-04de-4fd6-934a-e2fbf74c70ff tempest-VolumesSnapshotsTestJSON-990929192 tempest-VolumesSnapshotsTestJSON-990929192-project] Calling method '.version_select at 0x7f33a6737ee0>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:29:56.044426 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-b899e9ec-04de-4fd6-934a-e2fbf74c70ff tempest-VolumesSnapshotsTestJSON-990929192 tempest-VolumesSnapshotsTestJSON-990929192-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots/c9d1d528-de98-40ca-bab9-1c2f6895c08d" status: 200 len: 287 microversion: 2.1 time: 0.055456 Jan 18 16:29:56.050243 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 8/9] 10.222.0.82 () {58 vars in 1250 bytes} [Tue Jan 18 16:29:55 2022] GET /compute/v2.1/os-snapshots/c9d1d528-de98-40ca-bab9-1c2f6895c08d => generated 287 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:29:56.052490 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-b2b5bcb9-831d-46f8-bb90-4d91390a7e7d tempest-VolumesGetTestJSON-1948740035 tempest-VolumesGetTestJSON-1948740035-project] Calling method '.version_select at 0x7f33a6737b80>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:29:56.164882 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-b2b5bcb9-831d-46f8-bb90-4d91390a7e7d tempest-VolumesGetTestJSON-1948740035 tempest-VolumesGetTestJSON-1948740035-project] 10.222.0.82 "DELETE /compute/v2.1/os-volumes/4e9ef50a-c0db-48b9-bff8-1dae4ab5a455" status: 202 len: 0 microversion: 2.1 time: 0.116513 Jan 18 16:29:56.165928 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 9/10] 10.222.0.82 () {58 vars in 1247 bytes} [Tue Jan 18 16:29:56 2022] DELETE /compute/v2.1/os-volumes/4e9ef50a-c0db-48b9-bff8-1dae4ab5a455 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:29:56.180573 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-a311d587-0e0f-447e-9219-4c825df974b9 tempest-VolumesSnapshotsTestJSON-990929192 tempest-VolumesSnapshotsTestJSON-990929192-project] Calling method '.version_select at 0x7f33a674a670>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:29:56.254678 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-a311d587-0e0f-447e-9219-4c825df974b9 tempest-VolumesSnapshotsTestJSON-990929192 tempest-VolumesSnapshotsTestJSON-990929192-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.084097 Jan 18 16:29:56.255648 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 10/11] 10.222.0.82 () {58 vars in 1139 bytes} [Tue Jan 18 16:29:56 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:29:56.264696 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-eaeb9b37-e26d-4efc-add7-9ca47f969eea tempest-VolumesGetTestJSON-1948740035 tempest-VolumesGetTestJSON-1948740035-project] Calling method '.version_select at 0x7f33a66dc160>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:29:56.353085 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-eaeb9b37-e26d-4efc-add7-9ca47f969eea tempest-VolumesGetTestJSON-1948740035 tempest-VolumesGetTestJSON-1948740035-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/4e9ef50a-c0db-48b9-bff8-1dae4ab5a455" status: 200 len: 353 microversion: 2.1 time: 0.095296 Jan 18 16:29:56.353762 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 11/12] 10.222.0.82 () {58 vars in 1244 bytes} [Tue Jan 18 16:29:56 2022] GET /compute/v2.1/os-volumes/4e9ef50a-c0db-48b9-bff8-1dae4ab5a455 => generated 353 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:29:56.359254 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-9c34ebcb-22be-4e64-aa7c-7a720a319908 tempest-VolumesSnapshotsTestJSON-990929192 tempest-VolumesSnapshotsTestJSON-990929192-project] Calling method '.version_select at 0x7f33a674ad30>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:29:56.363730 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-afd08a9c-f313-44a9-abff-a5f471e15285 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Flavor limits 0:0:0 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 18 16:29:56.364293 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-afd08a9c-f313-44a9-abff-a5f471e15285 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Image limits 0:0:0 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 18 16:29:56.364624 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-afd08a9c-f313-44a9-abff-a5f471e15285 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Flavor pref 0:0:0 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 18 16:29:56.365061 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-afd08a9c-f313-44a9-abff-a5f471e15285 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Image pref 0:0:0 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 18 16:29:56.366713 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-afd08a9c-f313-44a9-abff-a5f471e15285 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 18 16:29:56.394883 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-afd08a9c-f313-44a9-abff-a5f471e15285 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:29:56.395643 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-afd08a9c-f313-44a9-abff-a5f471e15285 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:29:56.396879 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-afd08a9c-f313-44a9-abff-a5f471e15285 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:29:56.397541 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-afd08a9c-f313-44a9-abff-a5f471e15285 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:29:56.417201 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-9c34ebcb-22be-4e64-aa7c-7a720a319908 tempest-VolumesSnapshotsTestJSON-990929192 tempest-VolumesSnapshotsTestJSON-990929192-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots/c9d1d528-de98-40ca-bab9-1c2f6895c08d" status: 200 len: 287 microversion: 2.1 time: 0.062282 Jan 18 16:29:56.418157 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 12/13] 10.222.0.82 () {58 vars in 1250 bytes} [Tue Jan 18 16:29:56 2022] GET /compute/v2.1/os-snapshots/c9d1d528-de98-40ca-bab9-1c2f6895c08d => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:29:56.453433 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.quota [None req-afd08a9c-f313-44a9-abff-a5f471e15285 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Getting quotas for project b205cbc85b42462e9fb91e126616d33e. Resources: {'ram', 'instances', 'cores'} {{(pid=116368) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 16:29:56.462795 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.quota [None req-afd08a9c-f313-44a9-abff-a5f471e15285 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Getting quotas for user d441a94d1e434168a4563c2ed04adf12 and project b205cbc85b42462e9fb91e126616d33e. Resources: {'ram', 'instances', 'cores'} {{(pid=116368) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 16:29:56.478897 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-afd08a9c-f313-44a9-abff-a5f471e15285 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Going to run 1 instances... {{(pid=116368) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 18 16:29:56.483567 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-afd08a9c-f313-44a9-abff-a5f471e15285 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] [instance: 989d2f30-5220-48b9-99b1-743321171593] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='900c4a9d-b6c6-451f-a509-eb4f4b49f459',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116368) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 18 16:29:56.619960 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-afd08a9c-f313-44a9-abff-a5f471e15285 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.626868 Jan 18 16:29:56.629347 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 2/14] 10.222.0.82 () {60 vars in 1146 bytes} [Tue Jan 18 16:29:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 18 16:29:56.634247 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-b2695cd0-6c53-4d13-a6ae-050e9d6db967 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:29:56.635540 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-b2695cd0-6c53-4d13-a6ae-050e9d6db967 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] [instance: 989d2f30-5220-48b9-99b1-743321171593] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:29:56.788076 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-b2695cd0-6c53-4d13-a6ae-050e9d6db967 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441a94d1e434168a4563c2ed04adf12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b205cbc85b42462e9fb91e126616d33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:29:56.808485 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-b2695cd0-6c53-4d13-a6ae-050e9d6db967 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] 10.222.0.82 "GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593" status: 200 len: 1215 microversion: 2.1 time: 0.178006 Jan 18 16:29:56.811605 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 13/15] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:29:56 2022] GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593 => generated 1215 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:29:57.366578 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-a2b1bca3-e78e-4417-8cc3-fd57ed666b2e tempest-VolumesGetTestJSON-1948740035 tempest-VolumesGetTestJSON-1948740035-project] Calling method '.version_select at 0x7f33a664c5e0>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:29:57.428538 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-4a5dfe89-57a6-453d-b5f5-6acd2990dd40 tempest-VolumesSnapshotsTestJSON-990929192 tempest-VolumesSnapshotsTestJSON-990929192-project] Calling method '.version_select at 0x7f33a6737f70>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:29:57.446185 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-a2b1bca3-e78e-4417-8cc3-fd57ed666b2e tempest-VolumesGetTestJSON-1948740035 tempest-VolumesGetTestJSON-1948740035-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/4e9ef50a-c0db-48b9-bff8-1dae4ab5a455" status: 200 len: 353 microversion: 2.1 time: 0.084811 Jan 18 16:29:57.446970 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 3/16] 10.222.0.82 () {58 vars in 1244 bytes} [Tue Jan 18 16:29:57 2022] GET /compute/v2.1/os-volumes/4e9ef50a-c0db-48b9-bff8-1dae4ab5a455 => generated 353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:29:57.501332 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-4a5dfe89-57a6-453d-b5f5-6acd2990dd40 tempest-VolumesSnapshotsTestJSON-990929192 tempest-VolumesSnapshotsTestJSON-990929192-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots/c9d1d528-de98-40ca-bab9-1c2f6895c08d" status: 200 len: 287 microversion: 2.1 time: 0.076263 Jan 18 16:29:57.502502 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 14/17] 10.222.0.82 () {58 vars in 1250 bytes} [Tue Jan 18 16:29:57 2022] GET /compute/v2.1/os-snapshots/c9d1d528-de98-40ca-bab9-1c2f6895c08d => generated 287 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 16:29:57.827167 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-a8ce91a6-c4c4-4a5f-8bd3-dd6ad4a01b7b tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:29:57.827780 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-a8ce91a6-c4c4-4a5f-8bd3-dd6ad4a01b7b tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] [instance: 989d2f30-5220-48b9-99b1-743321171593] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:29:57.960361 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-a8ce91a6-c4c4-4a5f-8bd3-dd6ad4a01b7b tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441a94d1e434168a4563c2ed04adf12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b205cbc85b42462e9fb91e126616d33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:29:57.991897 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-a8ce91a6-c4c4-4a5f-8bd3-dd6ad4a01b7b tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] 10.222.0.82 "GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593" status: 200 len: 1215 microversion: 2.1 time: 0.168122 Jan 18 16:29:57.992528 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 4/18] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:29:57 2022] GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593 => generated 1215 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:29:58.460339 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-ee65c603-19ec-467d-be46-b685e63fca38 tempest-VolumesGetTestJSON-1948740035 tempest-VolumesGetTestJSON-1948740035-project] Calling method '.version_select at 0x7f33a67189d0>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:29:58.514932 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-e33a984c-cd2e-4048-a48d-dedc84b1a6d2 tempest-VolumesSnapshotsTestJSON-990929192 tempest-VolumesSnapshotsTestJSON-990929192-project] Calling method '.version_select at 0x7f33a664c940>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:29:58.538396 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-ee65c603-19ec-467d-be46-b685e63fca38 tempest-VolumesGetTestJSON-1948740035 tempest-VolumesGetTestJSON-1948740035-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/4e9ef50a-c0db-48b9-bff8-1dae4ab5a455" status: 200 len: 353 microversion: 2.1 time: 0.083091 Jan 18 16:29:58.543425 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 15/19] 10.222.0.82 () {58 vars in 1244 bytes} [Tue Jan 18 16:29:58 2022] GET /compute/v2.1/os-volumes/4e9ef50a-c0db-48b9-bff8-1dae4ab5a455 => generated 353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:29:58.552835 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-e33a984c-cd2e-4048-a48d-dedc84b1a6d2 tempest-VolumesSnapshotsTestJSON-990929192 tempest-VolumesSnapshotsTestJSON-990929192-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots/c9d1d528-de98-40ca-bab9-1c2f6895c08d" status: 200 len: 287 microversion: 2.1 time: 0.041873 Jan 18 16:29:58.554479 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 5/20] 10.222.0.82 () {58 vars in 1250 bytes} [Tue Jan 18 16:29:58 2022] GET /compute/v2.1/os-snapshots/c9d1d528-de98-40ca-bab9-1c2f6895c08d => generated 287 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:29:59.010344 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-04fe2e3b-b9b5-450b-8148-1cb5e5c3fc48 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:29:59.012337 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-04fe2e3b-b9b5-450b-8148-1cb5e5c3fc48 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] [instance: 989d2f30-5220-48b9-99b1-743321171593] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:29:59.043166 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-04fe2e3b-b9b5-450b-8148-1cb5e5c3fc48 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:29:59.044686 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-04fe2e3b-b9b5-450b-8148-1cb5e5c3fc48 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:29:59.048394 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-04fe2e3b-b9b5-450b-8148-1cb5e5c3fc48 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:29:59.050285 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-04fe2e3b-b9b5-450b-8148-1cb5e5c3fc48 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:29:59.517410 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-04fe2e3b-b9b5-450b-8148-1cb5e5c3fc48 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441a94d1e434168a4563c2ed04adf12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b205cbc85b42462e9fb91e126616d33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:29:59.535060 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-04fe2e3b-b9b5-450b-8148-1cb5e5c3fc48 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] 10.222.0.82 "GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593" status: 200 len: 1211 microversion: 2.1 time: 0.529887 Jan 18 16:29:59.535653 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 16/21] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:29:59 2022] GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593 => generated 1211 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:29:59.551070 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-3104240f-5643-40aa-9d44-fb650610e9f1 tempest-VolumesGetTestJSON-1948740035 tempest-VolumesGetTestJSON-1948740035-project] Calling method '.version_select at 0x7f33a5606160>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:29:59.565598 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-4e2af547-d966-4cc7-ac23-7bf62ef953bc tempest-VolumesSnapshotsTestJSON-990929192 tempest-VolumesSnapshotsTestJSON-990929192-project] Calling method '.version_select at 0x7f33a66214c0>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:29:59.613859 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.wsgi [None req-3104240f-5643-40aa-9d44-fb650610e9f1 tempest-VolumesGetTestJSON-1948740035 tempest-VolumesGetTestJSON-1948740035-project] HTTP exception thrown: Volume 4e9ef50a-c0db-48b9-bff8-1dae4ab5a455 could not be found. Jan 18 16:29:59.614686 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-3104240f-5643-40aa-9d44-fb650610e9f1 tempest-VolumesGetTestJSON-1948740035 tempest-VolumesGetTestJSON-1948740035-project] Returning 404 to user: Volume 4e9ef50a-c0db-48b9-bff8-1dae4ab5a455 could not be found. {{(pid=116368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 16:29:59.615681 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-3104240f-5643-40aa-9d44-fb650610e9f1 tempest-VolumesGetTestJSON-1948740035 tempest-VolumesGetTestJSON-1948740035-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/4e9ef50a-c0db-48b9-bff8-1dae4ab5a455" status: 404 len: 109 microversion: 2.1 time: 0.068976 Jan 18 16:29:59.616955 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 6/22] 10.222.0.82 () {58 vars in 1244 bytes} [Tue Jan 18 16:29:59 2022] GET /compute/v2.1/os-volumes/4e9ef50a-c0db-48b9-bff8-1dae4ab5a455 => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 16:29:59.641918 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-4e2af547-d966-4cc7-ac23-7bf62ef953bc tempest-VolumesSnapshotsTestJSON-990929192 tempest-VolumesSnapshotsTestJSON-990929192-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots/c9d1d528-de98-40ca-bab9-1c2f6895c08d" status: 200 len: 288 microversion: 2.1 time: 0.080924 Jan 18 16:29:59.646287 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 17/23] 10.222.0.82 () {58 vars in 1250 bytes} [Tue Jan 18 16:29:59 2022] GET /compute/v2.1/os-snapshots/c9d1d528-de98-40ca-bab9-1c2f6895c08d => generated 288 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:29:59.652638 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-cac7119b-c4d4-4eb1-97f1-18a310d98f00 tempest-VolumesSnapshotsTestJSON-990929192 tempest-VolumesSnapshotsTestJSON-990929192-project] Calling method '.version_select at 0x7f33a664cca0>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:29:59.794510 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-cac7119b-c4d4-4eb1-97f1-18a310d98f00 tempest-VolumesSnapshotsTestJSON-990929192 tempest-VolumesSnapshotsTestJSON-990929192-project] 10.222.0.82 "DELETE /compute/v2.1/os-snapshots/c9d1d528-de98-40ca-bab9-1c2f6895c08d" status: 202 len: 0 microversion: 2.1 time: 0.145659 Jan 18 16:29:59.799099 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 7/24] 10.222.0.82 () {58 vars in 1253 bytes} [Tue Jan 18 16:29:59 2022] DELETE /compute/v2.1/os-snapshots/c9d1d528-de98-40ca-bab9-1c2f6895c08d => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:29:59.805860 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-5387fbd6-e5bb-4fa2-9c5c-70fd2c77900d tempest-VolumesSnapshotsTestJSON-990929192 tempest-VolumesSnapshotsTestJSON-990929192-project] Calling method '.version_select at 0x7f33a66351f0>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:29:59.874948 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-5387fbd6-e5bb-4fa2-9c5c-70fd2c77900d tempest-VolumesSnapshotsTestJSON-990929192 tempest-VolumesSnapshotsTestJSON-990929192-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots/c9d1d528-de98-40ca-bab9-1c2f6895c08d" status: 200 len: 287 microversion: 2.1 time: 0.073829 Jan 18 16:29:59.875584 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 18/25] 10.222.0.82 () {58 vars in 1250 bytes} [Tue Jan 18 16:29:59 2022] GET /compute/v2.1/os-snapshots/c9d1d528-de98-40ca-bab9-1c2f6895c08d => generated 287 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 16:30:00.552077 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-c5f2fc2a-9f7e-4b1b-8fd2-eaca34b56c8d tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:00.552704 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-c5f2fc2a-9f7e-4b1b-8fd2-eaca34b56c8d tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] [instance: 989d2f30-5220-48b9-99b1-743321171593] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:00.569731 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c5f2fc2a-9f7e-4b1b-8fd2-eaca34b56c8d tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:00.570462 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c5f2fc2a-9f7e-4b1b-8fd2-eaca34b56c8d tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:00.572615 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c5f2fc2a-9f7e-4b1b-8fd2-eaca34b56c8d tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:00.573319 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c5f2fc2a-9f7e-4b1b-8fd2-eaca34b56c8d tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:00.887536 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-c3685ce5-8dc4-432c-a955-2ab0744a48d1 tempest-VolumesSnapshotsTestJSON-990929192 tempest-VolumesSnapshotsTestJSON-990929192-project] Calling method '.version_select at 0x7f33a6645940>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:00.951257 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.wsgi [None req-c3685ce5-8dc4-432c-a955-2ab0744a48d1 tempest-VolumesSnapshotsTestJSON-990929192 tempest-VolumesSnapshotsTestJSON-990929192-project] HTTP exception thrown: Snapshot c9d1d528-de98-40ca-bab9-1c2f6895c08d could not be found. Jan 18 16:30:00.951257 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-c3685ce5-8dc4-432c-a955-2ab0744a48d1 tempest-VolumesSnapshotsTestJSON-990929192 tempest-VolumesSnapshotsTestJSON-990929192-project] Returning 404 to user: Snapshot c9d1d528-de98-40ca-bab9-1c2f6895c08d could not be found. {{(pid=116367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 16:30:00.951585 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-c3685ce5-8dc4-432c-a955-2ab0744a48d1 tempest-VolumesSnapshotsTestJSON-990929192 tempest-VolumesSnapshotsTestJSON-990929192-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots/c9d1d528-de98-40ca-bab9-1c2f6895c08d" status: 404 len: 111 microversion: 2.1 time: 0.067875 Jan 18 16:30:00.952291 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 19/26] 10.222.0.82 () {58 vars in 1250 bytes} [Tue Jan 18 16:30:00 2022] GET /compute/v2.1/os-snapshots/c9d1d528-de98-40ca-bab9-1c2f6895c08d => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 18 16:30:00.960657 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-a5cde7df-7fdb-41f8-be00-1ce791b68967 tempest-VolumesSnapshotsTestJSON-990929192 tempest-VolumesSnapshotsTestJSON-990929192-project] Calling method '.version_select at 0x7f33a70ce4c0>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:01.232439 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-a5cde7df-7fdb-41f8-be00-1ce791b68967 tempest-VolumesSnapshotsTestJSON-990929192 tempest-VolumesSnapshotsTestJSON-990929192-project] 10.222.0.82 "DELETE /compute/v2.1/os-volumes/54085779-5a99-4788-bcac-fb542e99f3fe" status: 202 len: 0 microversion: 2.1 time: 0.275363 Jan 18 16:30:01.236612 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 20/27] 10.222.0.82 () {58 vars in 1247 bytes} [Tue Jan 18 16:30:00 2022] DELETE /compute/v2.1/os-volumes/54085779-5a99-4788-bcac-fb542e99f3fe => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 18 16:30:01.246128 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-e758f1f5-d978-4dc3-b30c-d9a9a273e98e tempest-VolumesSnapshotsTestJSON-990929192 tempest-VolumesSnapshotsTestJSON-990929192-project] Calling method '.version_select at 0x7f33a6621a60>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:01.393471 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-e758f1f5-d978-4dc3-b30c-d9a9a273e98e tempest-VolumesSnapshotsTestJSON-990929192 tempest-VolumesSnapshotsTestJSON-990929192-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/54085779-5a99-4788-bcac-fb542e99f3fe" status: 200 len: 345 microversion: 2.1 time: 0.153552 Jan 18 16:30:01.394204 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 21/28] 10.222.0.82 () {58 vars in 1244 bytes} [Tue Jan 18 16:30:01 2022] GET /compute/v2.1/os-volumes/54085779-5a99-4788-bcac-fb542e99f3fe => generated 345 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:30:01.683695 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-c5f2fc2a-9f7e-4b1b-8fd2-eaca34b56c8d tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441a94d1e434168a4563c2ed04adf12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b205cbc85b42462e9fb91e126616d33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:01.725740 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-c5f2fc2a-9f7e-4b1b-8fd2-eaca34b56c8d tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] 10.222.0.82 "GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593" status: 200 len: 1275 microversion: 2.1 time: 1.177607 Jan 18 16:30:01.741126 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 8/29] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:00 2022] GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593 => generated 1275 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:30:02.406600 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-654a612c-3735-46ce-9615-0faec55b8c00 tempest-VolumesSnapshotsTestJSON-990929192 tempest-VolumesSnapshotsTestJSON-990929192-project] Calling method '.version_select at 0x7f33a668ff70>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:02.455691 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.wsgi [None req-654a612c-3735-46ce-9615-0faec55b8c00 tempest-VolumesSnapshotsTestJSON-990929192 tempest-VolumesSnapshotsTestJSON-990929192-project] HTTP exception thrown: Volume 54085779-5a99-4788-bcac-fb542e99f3fe could not be found. Jan 18 16:30:02.456285 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-654a612c-3735-46ce-9615-0faec55b8c00 tempest-VolumesSnapshotsTestJSON-990929192 tempest-VolumesSnapshotsTestJSON-990929192-project] Returning 404 to user: Volume 54085779-5a99-4788-bcac-fb542e99f3fe could not be found. {{(pid=116367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 16:30:02.457136 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-654a612c-3735-46ce-9615-0faec55b8c00 tempest-VolumesSnapshotsTestJSON-990929192 tempest-VolumesSnapshotsTestJSON-990929192-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/54085779-5a99-4788-bcac-fb542e99f3fe" status: 404 len: 109 microversion: 2.1 time: 0.054148 Jan 18 16:30:02.463936 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 22/30] 10.222.0.82 () {58 vars in 1244 bytes} [Tue Jan 18 16:30:02 2022] GET /compute/v2.1/os-volumes/54085779-5a99-4788-bcac-fb542e99f3fe => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 16:30:02.470473 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-425debf5-00f3-4e41-bab1-2f0e5d3bfa7d tempest-VolumesSnapshotsTestJSON-990929192 tempest-VolumesSnapshotsTestJSON-990929192-project] Calling method '.version_select at 0x7f33a5532e50>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:02.532538 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.wsgi [None req-425debf5-00f3-4e41-bab1-2f0e5d3bfa7d tempest-VolumesSnapshotsTestJSON-990929192 tempest-VolumesSnapshotsTestJSON-990929192-project] HTTP exception thrown: Volume 54085779-5a99-4788-bcac-fb542e99f3fe could not be found. Jan 18 16:30:02.533470 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-425debf5-00f3-4e41-bab1-2f0e5d3bfa7d tempest-VolumesSnapshotsTestJSON-990929192 tempest-VolumesSnapshotsTestJSON-990929192-project] Returning 404 to user: Volume 54085779-5a99-4788-bcac-fb542e99f3fe could not be found. {{(pid=116368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 16:30:02.534678 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-425debf5-00f3-4e41-bab1-2f0e5d3bfa7d tempest-VolumesSnapshotsTestJSON-990929192 tempest-VolumesSnapshotsTestJSON-990929192-project] 10.222.0.82 "DELETE /compute/v2.1/os-volumes/54085779-5a99-4788-bcac-fb542e99f3fe" status: 404 len: 109 microversion: 2.1 time: 0.069293 Jan 18 16:30:02.535579 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 9/31] 10.222.0.82 () {58 vars in 1247 bytes} [Tue Jan 18 16:30:02 2022] DELETE /compute/v2.1/os-volumes/54085779-5a99-4788-bcac-fb542e99f3fe => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 16:30:02.544288 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-652b82fe-9efc-49a9-9b26-3639afc695eb tempest-VolumesSnapshotsTestJSON-990929192 tempest-VolumesSnapshotsTestJSON-990929192-project] Calling method '.version_select at 0x7f33a6645940>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:02.589760 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.wsgi [None req-652b82fe-9efc-49a9-9b26-3639afc695eb tempest-VolumesSnapshotsTestJSON-990929192 tempest-VolumesSnapshotsTestJSON-990929192-project] HTTP exception thrown: Volume 54085779-5a99-4788-bcac-fb542e99f3fe could not be found. Jan 18 16:30:02.590529 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-652b82fe-9efc-49a9-9b26-3639afc695eb tempest-VolumesSnapshotsTestJSON-990929192 tempest-VolumesSnapshotsTestJSON-990929192-project] Returning 404 to user: Volume 54085779-5a99-4788-bcac-fb542e99f3fe could not be found. {{(pid=116367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 16:30:02.591496 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-652b82fe-9efc-49a9-9b26-3639afc695eb tempest-VolumesSnapshotsTestJSON-990929192 tempest-VolumesSnapshotsTestJSON-990929192-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/54085779-5a99-4788-bcac-fb542e99f3fe" status: 404 len: 109 microversion: 2.1 time: 0.051539 Jan 18 16:30:02.595349 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 23/32] 10.222.0.82 () {58 vars in 1244 bytes} [Tue Jan 18 16:30:02 2022] GET /compute/v2.1/os-volumes/54085779-5a99-4788-bcac-fb542e99f3fe => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 16:30:02.747132 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-c1e3b51a-2d09-4dc8-add1-0ee7eabb2a8d tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:02.748567 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-c1e3b51a-2d09-4dc8-add1-0ee7eabb2a8d tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] [instance: 989d2f30-5220-48b9-99b1-743321171593] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:02.763736 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c1e3b51a-2d09-4dc8-add1-0ee7eabb2a8d tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:02.764549 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c1e3b51a-2d09-4dc8-add1-0ee7eabb2a8d tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:02.765893 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c1e3b51a-2d09-4dc8-add1-0ee7eabb2a8d tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:02.766453 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c1e3b51a-2d09-4dc8-add1-0ee7eabb2a8d tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:03.167956 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-c1e3b51a-2d09-4dc8-add1-0ee7eabb2a8d tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441a94d1e434168a4563c2ed04adf12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b205cbc85b42462e9fb91e126616d33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:03.247569 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-c1e3b51a-2d09-4dc8-add1-0ee7eabb2a8d tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] 10.222.0.82 "GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593" status: 200 len: 1273 microversion: 2.1 time: 0.501524 Jan 18 16:30:03.280806 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 10/33] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:02 2022] GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593 => generated 1273 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:30:04.270953 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-9a6977bd-f82e-418d-8859-0503bcf0d5fa tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:04.271797 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-9a6977bd-f82e-418d-8859-0503bcf0d5fa tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] [instance: 989d2f30-5220-48b9-99b1-743321171593] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:04.284895 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-9a6977bd-f82e-418d-8859-0503bcf0d5fa tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:04.287187 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-9a6977bd-f82e-418d-8859-0503bcf0d5fa tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:04.288423 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-9a6977bd-f82e-418d-8859-0503bcf0d5fa tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:04.291917 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-9a6977bd-f82e-418d-8859-0503bcf0d5fa tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:04.673391 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-9a6977bd-f82e-418d-8859-0503bcf0d5fa tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441a94d1e434168a4563c2ed04adf12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b205cbc85b42462e9fb91e126616d33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:04.688906 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-9a6977bd-f82e-418d-8859-0503bcf0d5fa tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] 10.222.0.82 "GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593" status: 200 len: 1273 microversion: 2.1 time: 0.422275 Jan 18 16:30:04.715309 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 24/34] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:04 2022] GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593 => generated 1273 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:30:05.574017 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-d69f8596-0e0f-41d9-9dc9-1433bbba6b36 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'create', calling method: .version_select at 0x7f33a5582940>, body: {"keypair": {"name": "tempest-keypair-1629316580"}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:30:05.643979 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.quota [None req-d69f8596-0e0f-41d9-9dc9-1433bbba6b36 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Getting quotas for project 6ec6b09b84c64d969dd91ab88dc56e8c. Resources: {'key_pairs'} {{(pid=116368) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 16:30:05.665924 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.quota [None req-d69f8596-0e0f-41d9-9dc9-1433bbba6b36 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Getting quotas for user 996b56c77ddc470e9ed536ae6936acbd and project 6ec6b09b84c64d969dd91ab88dc56e8c. Resources: {'key_pairs'} {{(pid=116368) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 16:30:05.728115 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-54623e6a-6824-4e32-a5e6-a8bd4b20104b tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:05.728723 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-54623e6a-6824-4e32-a5e6-a8bd4b20104b tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] [instance: 989d2f30-5220-48b9-99b1-743321171593] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:05.743797 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-54623e6a-6824-4e32-a5e6-a8bd4b20104b tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:05.744533 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-54623e6a-6824-4e32-a5e6-a8bd4b20104b tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:05.745548 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-54623e6a-6824-4e32-a5e6-a8bd4b20104b tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:05.746425 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-54623e6a-6824-4e32-a5e6-a8bd4b20104b tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:06.167015 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-54623e6a-6824-4e32-a5e6-a8bd4b20104b tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441a94d1e434168a4563c2ed04adf12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b205cbc85b42462e9fb91e126616d33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:06.178706 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-54623e6a-6824-4e32-a5e6-a8bd4b20104b tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] 10.222.0.82 "GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593" status: 200 len: 1315 microversion: 2.1 time: 0.454518 Jan 18 16:30:06.190571 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 25/35] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:05 2022] GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593 => generated 1315 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:30:06.302531 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.quota [None req-d69f8596-0e0f-41d9-9dc9-1433bbba6b36 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Getting quotas for project 6ec6b09b84c64d969dd91ab88dc56e8c. Resources: {'key_pairs'} {{(pid=116368) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 16:30:06.321977 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.quota [None req-d69f8596-0e0f-41d9-9dc9-1433bbba6b36 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Getting quotas for user 996b56c77ddc470e9ed536ae6936acbd and project 6ec6b09b84c64d969dd91ab88dc56e8c. Resources: {'key_pairs'} {{(pid=116368) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 16:30:06.372360 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-d69f8596-0e0f-41d9-9dc9-1433bbba6b36 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 1.439628 Jan 18 16:30:06.381573 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 11/36] 10.222.0.82 () {62 vars in 1198 bytes} [Tue Jan 18 16:30:04 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 1453 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 18 16:30:07.203854 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-fad3f559-b10f-491f-a951-5f646c8c0a9c tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:07.205505 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-fad3f559-b10f-491f-a951-5f646c8c0a9c tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] [instance: 989d2f30-5220-48b9-99b1-743321171593] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:07.213194 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-fad3f559-b10f-491f-a951-5f646c8c0a9c tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:07.214583 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-fad3f559-b10f-491f-a951-5f646c8c0a9c tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:07.215689 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-fad3f559-b10f-491f-a951-5f646c8c0a9c tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:07.216388 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-fad3f559-b10f-491f-a951-5f646c8c0a9c tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:07.762262 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-c502e509-05ae-4db2-ae30-9a1a31e8c948 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-766725955", "imageRef": "900c4a9d-b6c6-451f-a509-eb4f4b49f459", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e0778d95-b90a-4014-b401-c41ebc0e7209"}]}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:30:07.830456 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-fad3f559-b10f-491f-a951-5f646c8c0a9c tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441a94d1e434168a4563c2ed04adf12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b205cbc85b42462e9fb91e126616d33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:07.843507 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-fad3f559-b10f-491f-a951-5f646c8c0a9c tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] 10.222.0.82 "GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593" status: 200 len: 1315 microversion: 2.1 time: 0.648453 Jan 18 16:30:07.858734 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 12/37] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:07 2022] GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593 => generated 1315 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:30:08.072698 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.network.neutron [None req-c502e509-05ae-4db2-ae30-9a1a31e8c948 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] validate_networks() for [('e0778d95-b90a-4014-b401-c41ebc0e7209', None, None, None, None, None)] {{(pid=116367) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 18 16:30:08.865430 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-f8e4fe87-79da-40ab-a661-d2afa3f561c0 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:08.866740 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-f8e4fe87-79da-40ab-a661-d2afa3f561c0 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] [instance: 989d2f30-5220-48b9-99b1-743321171593] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:08.876158 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f8e4fe87-79da-40ab-a661-d2afa3f561c0 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:08.879779 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f8e4fe87-79da-40ab-a661-d2afa3f561c0 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:08.881976 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f8e4fe87-79da-40ab-a661-d2afa3f561c0 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:08.882632 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f8e4fe87-79da-40ab-a661-d2afa3f561c0 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:09.787960 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-f8e4fe87-79da-40ab-a661-d2afa3f561c0 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441a94d1e434168a4563c2ed04adf12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b205cbc85b42462e9fb91e126616d33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:09.853272 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-f8e4fe87-79da-40ab-a661-d2afa3f561c0 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] 10.222.0.82 "GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593" status: 200 len: 1315 microversion: 2.1 time: 0.993756 Jan 18 16:30:09.869711 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 13/38] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:08 2022] GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593 => generated 1315 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:30:10.887363 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-0cbf6e75-00d3-4ac8-be87-6ad47730aa0d tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:10.889063 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-0cbf6e75-00d3-4ac8-be87-6ad47730aa0d tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] [instance: 989d2f30-5220-48b9-99b1-743321171593] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:10.903046 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0cbf6e75-00d3-4ac8-be87-6ad47730aa0d tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:10.903505 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0cbf6e75-00d3-4ac8-be87-6ad47730aa0d tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:10.910748 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0cbf6e75-00d3-4ac8-be87-6ad47730aa0d tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:10.922158 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0cbf6e75-00d3-4ac8-be87-6ad47730aa0d tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:11.936485 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-0cbf6e75-00d3-4ac8-be87-6ad47730aa0d tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441a94d1e434168a4563c2ed04adf12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b205cbc85b42462e9fb91e126616d33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:11.948368 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-0cbf6e75-00d3-4ac8-be87-6ad47730aa0d tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] 10.222.0.82 "GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593" status: 200 len: 1315 microversion: 2.1 time: 1.064913 Jan 18 16:30:11.949506 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 14/39] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:10 2022] GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593 => generated 1315 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:30:11.962984 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.virt.hardware [None req-c502e509-05ae-4db2-ae30-9a1a31e8c948 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Flavor limits 0:0:0 {{(pid=116367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 18 16:30:11.964128 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.virt.hardware [None req-c502e509-05ae-4db2-ae30-9a1a31e8c948 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Image limits 0:0:0 {{(pid=116367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 18 16:30:11.964809 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.virt.hardware [None req-c502e509-05ae-4db2-ae30-9a1a31e8c948 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Flavor pref 0:0:0 {{(pid=116367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 18 16:30:11.965466 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.virt.hardware [None req-c502e509-05ae-4db2-ae30-9a1a31e8c948 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Image pref 0:0:0 {{(pid=116367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 18 16:30:11.966105 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.virt.hardware [None req-c502e509-05ae-4db2-ae30-9a1a31e8c948 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 18 16:30:11.987705 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c502e509-05ae-4db2-ae30-9a1a31e8c948 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:11.988433 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c502e509-05ae-4db2-ae30-9a1a31e8c948 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:11.989488 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c502e509-05ae-4db2-ae30-9a1a31e8c948 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:11.990853 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c502e509-05ae-4db2-ae30-9a1a31e8c948 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:12.021563 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.quota [None req-c502e509-05ae-4db2-ae30-9a1a31e8c948 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Getting quotas for project de94f4e8303945cd884f4f15c31f0c7b. Resources: {'ram', 'instances', 'cores'} {{(pid=116367) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 16:30:12.028142 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.quota [None req-c502e509-05ae-4db2-ae30-9a1a31e8c948 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Getting quotas for user c8fc361080dd4249836a7427667d358c and project de94f4e8303945cd884f4f15c31f0c7b. Resources: {'ram', 'instances', 'cores'} {{(pid=116367) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 16:30:12.042030 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-c502e509-05ae-4db2-ae30-9a1a31e8c948 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Going to run 1 instances... {{(pid=116367) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 18 16:30:12.045257 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-c502e509-05ae-4db2-ae30-9a1a31e8c948 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='900c4a9d-b6c6-451f-a509-eb4f4b49f459',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 18 16:30:12.263572 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-c502e509-05ae-4db2-ae30-9a1a31e8c948 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.731222 Jan 18 16:30:12.270190 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 26/40] 10.222.0.82 () {60 vars in 1146 bytes} [Tue Jan 18 16:30:06 2022] POST /compute/v2.1/servers => generated 383 bytes in 5738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 18 16:30:12.902778 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [req-4b70583f-ee07-4184-ba03-c207d8fa6603 req-159531c3-e9dd-4592-a2c0-3aeb5edd8129 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "989d2f30-5220-48b9-99b1-743321171593", "tag": "ce661267-6290-428f-af8d-cd5d03d770e2"}]} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:30:12.905270 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:30:12.905270 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: warnings.warn(msg) Jan 18 16:30:12.940645 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-4b70583f-ee07-4184-ba03-c207d8fa6603 req-159531c3-e9dd-4592-a2c0-3aeb5edd8129 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:12.941558 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-4b70583f-ee07-4184-ba03-c207d8fa6603 req-159531c3-e9dd-4592-a2c0-3aeb5edd8129 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:13.028187 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.compute.server_external_events [req-4b70583f-ee07-4184-ba03-c207d8fa6603 req-159531c3-e9dd-4592-a2c0-3aeb5edd8129 service nova] Creating event network-changed:ce661267-6290-428f-af8d-cd5d03d770e2 for instance 989d2f30-5220-48b9-99b1-743321171593 on hv-cinder-78836 Jan 18 16:30:13.030790 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-4b70583f-ee07-4184-ba03-c207d8fa6603 req-159531c3-e9dd-4592-a2c0-3aeb5edd8129 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116368) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 18 16:30:13.033796 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-cb1eb4a5-c867-4842-894b-aa4698498f2a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:13.035530 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-cb1eb4a5-c867-4842-894b-aa4698498f2a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:13.039274 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-cb1eb4a5-c867-4842-894b-aa4698498f2a None None] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:13.040764 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-cb1eb4a5-c867-4842-894b-aa4698498f2a None None] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:13.072199 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.compute.rpcapi [None req-cb1eb4a5-c867-4842-894b-aa4698498f2a None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 18 16:30:13.075147 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-cb1eb4a5-c867-4842-894b-aa4698498f2a None None] Releasing lock "compute-rpcapi-router" {{(pid=116368) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 18 16:30:13.121621 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-cb1eb4a5-c867-4842-894b-aa4698498f2a None None] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.168841 Jan 18 16:30:13.133101 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 15/41] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:30:13.181256 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-4d4a1dc6-3338-455a-abaf-349cc7c4dec1 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:13.185205 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-4d4a1dc6-3338-455a-abaf-349cc7c4dec1 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:13.385673 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-dd38aa08-5652-48a6-9cfb-badfa7f2341f tempest-VolumesNegativeTest-61065682 tempest-VolumesNegativeTest-61065682-project] Action: 'create', calling method: .version_select at 0x7f33a6602670>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1703270350", "metadata": {"Type": "work"}}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:30:13.387214 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-dd38aa08-5652-48a6-9cfb-badfa7f2341f tempest-VolumesNegativeTest-61065682 tempest-VolumesNegativeTest-61065682-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 16:30:13.388290 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-dd38aa08-5652-48a6-9cfb-badfa7f2341f tempest-VolumesNegativeTest-61065682 tempest-VolumesNegativeTest-61065682-project] 10.222.0.82 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.116525 Jan 18 16:30:13.389325 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 27/42] 10.222.0.82 () {60 vars in 1155 bytes} [Tue Jan 18 16:30:12 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1118 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 18 16:30:13.404993 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-6e3112f8-deac-4a06-8d7c-b6a38f28d1c7 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:13.416501 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-6e3112f8-deac-4a06-8d7c-b6a38f28d1c7 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] [instance: 989d2f30-5220-48b9-99b1-743321171593] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:13.451417 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6e3112f8-deac-4a06-8d7c-b6a38f28d1c7 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:13.452814 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6e3112f8-deac-4a06-8d7c-b6a38f28d1c7 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:13.459049 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6e3112f8-deac-4a06-8d7c-b6a38f28d1c7 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:13.461110 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6e3112f8-deac-4a06-8d7c-b6a38f28d1c7 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:13.795986 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-4d4a1dc6-3338-455a-abaf-349cc7c4dec1 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:13.805421 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-4d4a1dc6-3338-455a-abaf-349cc7c4dec1 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1221 microversion: 2.1 time: 0.666809 Jan 18 16:30:13.811237 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 16/43] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:13 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1221 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:30:13.831412 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-58c9b712-0bf0-41c9-baff-63b7511f406b tempest-VolumesNegativeTest-61065682 tempest-VolumesNegativeTest-61065682-project] Action: 'create', calling method: .version_select at 0x7f33a55f8160>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-172275159", "metadata": {"Type": "work"}}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:30:13.844039 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-58c9b712-0bf0-41c9-baff-63b7511f406b tempest-VolumesNegativeTest-61065682 tempest-VolumesNegativeTest-61065682-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 16:30:13.847523 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-58c9b712-0bf0-41c9-baff-63b7511f406b tempest-VolumesNegativeTest-61065682 tempest-VolumesNegativeTest-61065682-project] 10.222.0.82 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.033839 Jan 18 16:30:13.858120 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 17/44] 10.222.0.82 () {60 vars in 1155 bytes} [Tue Jan 18 16:30:13 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 18 16:30:13.879054 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-c5875bd0-86d3-4a01-bceb-5fe17ef49899 tempest-VolumesNegativeTest-61065682 tempest-VolumesNegativeTest-61065682-project] Action: 'create', calling method: .version_select at 0x7f33a55f8160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1882240594", "metadata": {"Type": "work"}}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:30:13.889351 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-c5875bd0-86d3-4a01-bceb-5fe17ef49899 tempest-VolumesNegativeTest-61065682 tempest-VolumesNegativeTest-61065682-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 16:30:13.893899 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-c5875bd0-86d3-4a01-bceb-5fe17ef49899 tempest-VolumesNegativeTest-61065682 tempest-VolumesNegativeTest-61065682-project] 10.222.0.82 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.033549 Jan 18 16:30:13.896359 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 18/45] 10.222.0.82 () {60 vars in 1155 bytes} [Tue Jan 18 16:30:13 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 18 16:30:13.906520 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-8b8859e9-e223-41b2-88f3-8e05ce008db6 tempest-VolumesNegativeTest-61065682 tempest-VolumesNegativeTest-61065682-project] Calling method '.version_select at 0x7f33a5582af0>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:14.001666 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.wsgi [None req-8b8859e9-e223-41b2-88f3-8e05ce008db6 tempest-VolumesNegativeTest-61065682 tempest-VolumesNegativeTest-61065682-project] HTTP exception thrown: Volume tempest-invalid-549772265 could not be found. Jan 18 16:30:14.002444 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-8b8859e9-e223-41b2-88f3-8e05ce008db6 tempest-VolumesNegativeTest-61065682 tempest-VolumesNegativeTest-61065682-project] Returning 404 to user: Volume tempest-invalid-549772265 could not be found. {{(pid=116368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 16:30:14.003295 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-8b8859e9-e223-41b2-88f3-8e05ce008db6 tempest-VolumesNegativeTest-61065682 tempest-VolumesNegativeTest-61065682-project] 10.222.0.82 "DELETE /compute/v2.1/os-volumes/tempest-invalid-549772265" status: 404 len: 98 microversion: 2.1 time: 0.103386 Jan 18 16:30:14.004036 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 19/46] 10.222.0.82 () {58 vars in 1214 bytes} [Tue Jan 18 16:30:13 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-549772265 => generated 98 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 18 16:30:14.030445 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-d01de59b-8537-43d1-834a-add61418dc0e tempest-VolumesNegativeTest-61065682 tempest-VolumesNegativeTest-61065682-project] 10.222.0.82 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.011142 Jan 18 16:30:14.030445 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 20/47] 10.222.0.82 () {58 vars in 1139 bytes} [Tue Jan 18 16:30:14 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 18 16:30:14.039671 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-6064e9fa-959b-4173-8146-d5dee5d79198 tempest-VolumesNegativeTest-61065682 tempest-VolumesNegativeTest-61065682-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008341 Jan 18 16:30:14.042858 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 21/48] 10.222.0.82 () {58 vars in 1136 bytes} [Tue Jan 18 16:30:14 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 18 16:30:14.053549 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-52953c8e-a764-4587-b076-846ed92ccdee tempest-VolumesNegativeTest-61065682 tempest-VolumesNegativeTest-61065682-project] Calling method '.version_select at 0x7f33a70ce3a0>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:14.130111 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.wsgi [None req-52953c8e-a764-4587-b076-846ed92ccdee tempest-VolumesNegativeTest-61065682 tempest-VolumesNegativeTest-61065682-project] HTTP exception thrown: Volume 22fe5c5c-1f69-471b-ab4c-3741e8ab97f4 could not be found. Jan 18 16:30:14.130891 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-52953c8e-a764-4587-b076-846ed92ccdee tempest-VolumesNegativeTest-61065682 tempest-VolumesNegativeTest-61065682-project] Returning 404 to user: Volume 22fe5c5c-1f69-471b-ab4c-3741e8ab97f4 could not be found. {{(pid=116368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 16:30:14.132653 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-52953c8e-a764-4587-b076-846ed92ccdee tempest-VolumesNegativeTest-61065682 tempest-VolumesNegativeTest-61065682-project] 10.222.0.82 "DELETE /compute/v2.1/os-volumes/22fe5c5c-1f69-471b-ab4c-3741e8ab97f4" status: 404 len: 109 microversion: 2.1 time: 0.086980 Jan 18 16:30:14.133980 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 22/49] 10.222.0.82 () {58 vars in 1247 bytes} [Tue Jan 18 16:30:14 2022] DELETE /compute/v2.1/os-volumes/22fe5c5c-1f69-471b-ab4c-3741e8ab97f4 => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 16:30:14.164003 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-bd24d058-697c-48cf-84cd-231916e05a1d tempest-VolumesNegativeTest-61065682 tempest-VolumesNegativeTest-61065682-project] Calling method '.version_select at 0x7f33a54dd310>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:14.180651 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-6e3112f8-deac-4a06-8d7c-b6a38f28d1c7 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441a94d1e434168a4563c2ed04adf12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b205cbc85b42462e9fb91e126616d33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:14.194458 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-6e3112f8-deac-4a06-8d7c-b6a38f28d1c7 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] 10.222.0.82 "GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593" status: 200 len: 1315 microversion: 2.1 time: 0.800619 Jan 18 16:30:14.196725 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 28/50] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:13 2022] GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593 => generated 1315 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:30:14.246146 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.wsgi [None req-bd24d058-697c-48cf-84cd-231916e05a1d tempest-VolumesNegativeTest-61065682 tempest-VolumesNegativeTest-61065682-project] HTTP exception thrown: Volume eca4a11c-2638-4082-8f1e-e5ca08fdc5e1 could not be found. Jan 18 16:30:14.247239 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-bd24d058-697c-48cf-84cd-231916e05a1d tempest-VolumesNegativeTest-61065682 tempest-VolumesNegativeTest-61065682-project] Returning 404 to user: Volume eca4a11c-2638-4082-8f1e-e5ca08fdc5e1 could not be found. {{(pid=116368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 16:30:14.248312 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-bd24d058-697c-48cf-84cd-231916e05a1d tempest-VolumesNegativeTest-61065682 tempest-VolumesNegativeTest-61065682-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/eca4a11c-2638-4082-8f1e-e5ca08fdc5e1" status: 404 len: 109 microversion: 2.1 time: 0.098268 Jan 18 16:30:14.250006 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 23/51] 10.222.0.82 () {58 vars in 1244 bytes} [Tue Jan 18 16:30:14 2022] GET /compute/v2.1/os-volumes/eca4a11c-2638-4082-8f1e-e5ca08fdc5e1 => generated 109 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 16:30:14.566467 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-f03e2bca-b512-41ac-bf1b-6c3958d7a1d2 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-410765550", "imageRef": "900c4a9d-b6c6-451f-a509-eb4f4b49f459", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e0778d95-b90a-4014-b401-c41ebc0e7209"}]}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:30:14.567424 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-bc7ecbc6-0cb0-4b23-8037-8a1272793630 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1374937446", "imageRef": "900c4a9d-b6c6-451f-a509-eb4f4b49f459", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e334f1c7-d732-446e-8bed-e601fcceb421"}], "security_groups": [{"name": "tempest-securitygroup--899560667"}], "key_name": "tempest-keypair-1629316580", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:30:14.875277 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.network.neutron [None req-f03e2bca-b512-41ac-bf1b-6c3958d7a1d2 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] validate_networks() for [('e0778d95-b90a-4014-b401-c41ebc0e7209', None, None, None, None, None)] {{(pid=116367) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 18 16:30:15.491935 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.network.neutron [None req-bc7ecbc6-0cb0-4b23-8037-8a1272793630 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] validate_networks() for [('e334f1c7-d732-446e-8bed-e601fcceb421', None, None, None, None, None)] {{(pid=116368) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 18 16:30:16.320200 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.virt.hardware [None req-f03e2bca-b512-41ac-bf1b-6c3958d7a1d2 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Flavor limits 0:0:0 {{(pid=116367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 18 16:30:16.320848 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.virt.hardware [None req-f03e2bca-b512-41ac-bf1b-6c3958d7a1d2 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Image limits 0:0:0 {{(pid=116367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 18 16:30:16.321383 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.virt.hardware [None req-f03e2bca-b512-41ac-bf1b-6c3958d7a1d2 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Flavor pref 0:0:0 {{(pid=116367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 18 16:30:16.322015 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.virt.hardware [None req-f03e2bca-b512-41ac-bf1b-6c3958d7a1d2 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Image pref 0:0:0 {{(pid=116367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 18 16:30:16.322378 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.virt.hardware [None req-f03e2bca-b512-41ac-bf1b-6c3958d7a1d2 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 18 16:30:16.352034 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-f03e2bca-b512-41ac-bf1b-6c3958d7a1d2 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:16.353238 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-f03e2bca-b512-41ac-bf1b-6c3958d7a1d2 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:16.357166 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-f03e2bca-b512-41ac-bf1b-6c3958d7a1d2 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:16.360716 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-f03e2bca-b512-41ac-bf1b-6c3958d7a1d2 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:16.424839 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.quota [None req-f03e2bca-b512-41ac-bf1b-6c3958d7a1d2 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Getting quotas for project de94f4e8303945cd884f4f15c31f0c7b. Resources: {'ram', 'instances', 'cores'} {{(pid=116367) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 16:30:16.450602 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.quota [None req-f03e2bca-b512-41ac-bf1b-6c3958d7a1d2 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Getting quotas for user c8fc361080dd4249836a7427667d358c and project de94f4e8303945cd884f4f15c31f0c7b. Resources: {'ram', 'instances', 'cores'} {{(pid=116367) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 16:30:16.471664 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-bc7ecbc6-0cb0-4b23-8037-8a1272793630 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Flavor limits 0:0:0 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 18 16:30:16.472091 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-bc7ecbc6-0cb0-4b23-8037-8a1272793630 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Image limits 0:0:0 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 18 16:30:16.472591 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-bc7ecbc6-0cb0-4b23-8037-8a1272793630 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Flavor pref 0:0:0 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 18 16:30:16.473487 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-bc7ecbc6-0cb0-4b23-8037-8a1272793630 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Image pref 0:0:0 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 18 16:30:16.473877 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-bc7ecbc6-0cb0-4b23-8037-8a1272793630 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 18 16:30:16.485426 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-bc7ecbc6-0cb0-4b23-8037-8a1272793630 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:16.486510 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-bc7ecbc6-0cb0-4b23-8037-8a1272793630 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:16.487462 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-bc7ecbc6-0cb0-4b23-8037-8a1272793630 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:16.488220 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-bc7ecbc6-0cb0-4b23-8037-8a1272793630 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:16.509244 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-f03e2bca-b512-41ac-bf1b-6c3958d7a1d2 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Going to run 1 instances... {{(pid=116367) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 18 16:30:16.509935 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.quota [None req-bc7ecbc6-0cb0-4b23-8037-8a1272793630 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Getting quotas for project 6ec6b09b84c64d969dd91ab88dc56e8c. Resources: {'ram', 'instances', 'cores'} {{(pid=116368) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 16:30:16.512450 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-f03e2bca-b512-41ac-bf1b-6c3958d7a1d2 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='900c4a9d-b6c6-451f-a509-eb4f4b49f459',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 18 16:30:16.521727 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.quota [None req-bc7ecbc6-0cb0-4b23-8037-8a1272793630 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Getting quotas for user 996b56c77ddc470e9ed536ae6936acbd and project 6ec6b09b84c64d969dd91ab88dc56e8c. Resources: {'ram', 'instances', 'cores'} {{(pid=116368) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 16:30:16.534581 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-bc7ecbc6-0cb0-4b23-8037-8a1272793630 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Going to run 1 instances... {{(pid=116368) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 18 16:30:16.536908 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-bc7ecbc6-0cb0-4b23-8037-8a1272793630 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='900c4a9d-b6c6-451f-a509-eb4f4b49f459',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116368) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 18 16:30:16.576468 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-f03e2bca-b512-41ac-bf1b-6c3958d7a1d2 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.024124 Jan 18 16:30:16.577710 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 29/52] 10.222.0.82 () {60 vars in 1146 bytes} [Tue Jan 18 16:30:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 2026 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 18 16:30:16.585869 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-e69efb39-5ce2-470e-9cdb-296e276b98a4 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:16.587208 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-e69efb39-5ce2-470e-9cdb-296e276b98a4 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] [instance: 989d2f30-5220-48b9-99b1-743321171593] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:16.602166 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e69efb39-5ce2-470e-9cdb-296e276b98a4 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:16.604607 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e69efb39-5ce2-470e-9cdb-296e276b98a4 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:16.607319 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e69efb39-5ce2-470e-9cdb-296e276b98a4 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:16.608303 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e69efb39-5ce2-470e-9cdb-296e276b98a4 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:16.621518 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-bc7ecbc6-0cb0-4b23-8037-8a1272793630 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.068078 Jan 18 16:30:16.630370 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 24/53] 10.222.0.82 () {62 vars in 1187 bytes} [Tue Jan 18 16:30:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 2072 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 18 16:30:16.634694 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-87a22c6d-a784-4da6-8545-edc69703b571 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:16.638101 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-87a22c6d-a784-4da6-8545-edc69703b571 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:16.795441 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-87a22c6d-a784-4da6-8545-edc69703b571 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:16.803671 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-87a22c6d-a784-4da6-8545-edc69703b571 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1221 microversion: 2.1 time: 0.177663 Jan 18 16:30:16.807912 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 25/54] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:16 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1221 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:30:16.830505 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-afa28a9a-c2bc-4b18-b4e5-8437aa1b6155 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:16.832582 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-afa28a9a-c2bc-4b18-b4e5-8437aa1b6155 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:16.951113 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-e69efb39-5ce2-470e-9cdb-296e276b98a4 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441a94d1e434168a4563c2ed04adf12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b205cbc85b42462e9fb91e126616d33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:16.968260 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-e69efb39-5ce2-470e-9cdb-296e276b98a4 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] 10.222.0.82 "GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593" status: 200 len: 1315 microversion: 2.1 time: 0.389250 Jan 18 16:30:16.975017 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 30/55] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:16 2022] GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593 => generated 1315 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:30:16.979547 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-afa28a9a-c2bc-4b18-b4e5-8437aa1b6155 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:16.987887 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-afa28a9a-c2bc-4b18-b4e5-8437aa1b6155 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:16.991005 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-afa28a9a-c2bc-4b18-b4e5-8437aa1b6155 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:16.992135 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-afa28a9a-c2bc-4b18-b4e5-8437aa1b6155 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1282 microversion: 2.20 time: 0.172924 Jan 18 16:30:16.998222 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 26/56] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:30:16 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1282 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:30:17.823820 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-6f815073-9417-4a68-9089-0ca80a94397d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:17.824442 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-6f815073-9417-4a68-9089-0ca80a94397d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:17.832813 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6f815073-9417-4a68-9089-0ca80a94397d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:17.840458 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6f815073-9417-4a68-9089-0ca80a94397d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:17.841358 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6f815073-9417-4a68-9089-0ca80a94397d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:17.841816 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6f815073-9417-4a68-9089-0ca80a94397d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:17.988096 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-2e8cc895-2df3-42d0-966c-1cbfe3872f4c tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:17.989414 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-2e8cc895-2df3-42d0-966c-1cbfe3872f4c tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] [instance: 989d2f30-5220-48b9-99b1-743321171593] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:18.003375 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-2e8cc895-2df3-42d0-966c-1cbfe3872f4c tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:18.004013 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-2e8cc895-2df3-42d0-966c-1cbfe3872f4c tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:18.005010 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-2e8cc895-2df3-42d0-966c-1cbfe3872f4c tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:18.005609 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-2e8cc895-2df3-42d0-966c-1cbfe3872f4c tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:18.028892 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-6f815073-9417-4a68-9089-0ca80a94397d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:18.045852 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-6f815073-9417-4a68-9089-0ca80a94397d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1273 microversion: 2.1 time: 0.225930 Jan 18 16:30:18.055380 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 31/57] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:17 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1273 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:30:18.080607 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-fc12339e-07c0-466a-b24c-3610f6ca7012 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:18.081562 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-fc12339e-07c0-466a-b24c-3610f6ca7012 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:18.096192 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-fc12339e-07c0-466a-b24c-3610f6ca7012 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:18.096672 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-fc12339e-07c0-466a-b24c-3610f6ca7012 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:18.097530 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-fc12339e-07c0-466a-b24c-3610f6ca7012 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:18.098106 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-fc12339e-07c0-466a-b24c-3610f6ca7012 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:18.244320 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-fc12339e-07c0-466a-b24c-3610f6ca7012 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:18.257480 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-fc12339e-07c0-466a-b24c-3610f6ca7012 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:18.259008 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-fc12339e-07c0-466a-b24c-3610f6ca7012 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:18.266018 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-fc12339e-07c0-466a-b24c-3610f6ca7012 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1334 microversion: 2.20 time: 0.209293 Jan 18 16:30:18.266607 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 32/58] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:30:18 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1334 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:30:18.288125 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-2e8cc895-2df3-42d0-966c-1cbfe3872f4c tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441a94d1e434168a4563c2ed04adf12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b205cbc85b42462e9fb91e126616d33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:18.301457 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-2e8cc895-2df3-42d0-966c-1cbfe3872f4c tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] 10.222.0.82 "GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593" status: 200 len: 1315 microversion: 2.1 time: 0.316622 Jan 18 16:30:18.302081 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 27/59] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:17 2022] GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593 => generated 1315 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:30:19.067370 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-73cacccf-80e2-4e24-8395-700eb78bcc0e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:19.068449 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-73cacccf-80e2-4e24-8395-700eb78bcc0e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:19.080645 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-73cacccf-80e2-4e24-8395-700eb78bcc0e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:19.082797 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-73cacccf-80e2-4e24-8395-700eb78bcc0e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:19.084793 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-73cacccf-80e2-4e24-8395-700eb78bcc0e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:19.087965 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-73cacccf-80e2-4e24-8395-700eb78bcc0e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:19.234038 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-73cacccf-80e2-4e24-8395-700eb78bcc0e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:19.246197 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-73cacccf-80e2-4e24-8395-700eb78bcc0e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1279 microversion: 2.1 time: 0.183811 Jan 18 16:30:19.257533 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 33/60] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:19 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1279 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:30:19.287689 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-3f3edd6e-1992-4aa9-8549-c7b5dc7fe6d3 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:19.289737 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-3f3edd6e-1992-4aa9-8549-c7b5dc7fe6d3 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:19.307208 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3f3edd6e-1992-4aa9-8549-c7b5dc7fe6d3 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:19.310227 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3f3edd6e-1992-4aa9-8549-c7b5dc7fe6d3 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:19.315316 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3f3edd6e-1992-4aa9-8549-c7b5dc7fe6d3 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:19.316541 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3f3edd6e-1992-4aa9-8549-c7b5dc7fe6d3 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:19.318908 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-8f12f52b-ef60-4de0-b389-b6474812b291 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:19.319555 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-8f12f52b-ef60-4de0-b389-b6474812b291 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] [instance: 989d2f30-5220-48b9-99b1-743321171593] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:19.328131 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-8f12f52b-ef60-4de0-b389-b6474812b291 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:19.328131 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-8f12f52b-ef60-4de0-b389-b6474812b291 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:19.335150 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-8f12f52b-ef60-4de0-b389-b6474812b291 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:19.335150 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-8f12f52b-ef60-4de0-b389-b6474812b291 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:19.452400 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-3f3edd6e-1992-4aa9-8549-c7b5dc7fe6d3 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:19.467054 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-3f3edd6e-1992-4aa9-8549-c7b5dc7fe6d3 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:19.468565 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-3f3edd6e-1992-4aa9-8549-c7b5dc7fe6d3 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:19.474097 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-3f3edd6e-1992-4aa9-8549-c7b5dc7fe6d3 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1340 microversion: 2.20 time: 0.190990 Jan 18 16:30:19.474913 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 28/61] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:30:19 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1340 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:30:20.009251 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [req-ee7dfc98-d711-4bd3-8c05-3cd67094cc0f req-02963efe-d6c9-4316-8e80-96c271b1730d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c862639d-6995-43e1-9c7a-3d4f416629fc", "tag": "26efc157-2c4a-47a9-adb9-526b31015bd6"}]} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:30:20.011595 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:30:20.011595 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: warnings.warn(msg) Jan 18 16:30:20.029310 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-ee7dfc98-d711-4bd3-8c05-3cd67094cc0f req-02963efe-d6c9-4316-8e80-96c271b1730d service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:20.029810 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-ee7dfc98-d711-4bd3-8c05-3cd67094cc0f req-02963efe-d6c9-4316-8e80-96c271b1730d service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:20.066910 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.compute.server_external_events [req-ee7dfc98-d711-4bd3-8c05-3cd67094cc0f req-02963efe-d6c9-4316-8e80-96c271b1730d service nova] Creating event network-changed:26efc157-2c4a-47a9-adb9-526b31015bd6 for instance c862639d-6995-43e1-9c7a-3d4f416629fc on hv-cinder-78836 Jan 18 16:30:20.095064 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [req-ee7dfc98-d711-4bd3-8c05-3cd67094cc0f req-02963efe-d6c9-4316-8e80-96c271b1730d service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089965 Jan 18 16:30:20.096163 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 29/62] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:30:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:30:20.124349 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-8f12f52b-ef60-4de0-b389-b6474812b291 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441a94d1e434168a4563c2ed04adf12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b205cbc85b42462e9fb91e126616d33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:20.140882 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-8f12f52b-ef60-4de0-b389-b6474812b291 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] 10.222.0.82 "GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593" status: 200 len: 1315 microversion: 2.1 time: 0.826070 Jan 18 16:30:20.149042 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 34/63] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:19 2022] GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593 => generated 1315 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:30:20.269639 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-8c75aa86-67d7-4d1b-9c7f-eda19e26b7fb tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:20.271125 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-8c75aa86-67d7-4d1b-9c7f-eda19e26b7fb tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:20.284584 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8c75aa86-67d7-4d1b-9c7f-eda19e26b7fb tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:20.285115 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8c75aa86-67d7-4d1b-9c7f-eda19e26b7fb tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:20.285948 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8c75aa86-67d7-4d1b-9c7f-eda19e26b7fb tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:20.286391 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8c75aa86-67d7-4d1b-9c7f-eda19e26b7fb tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:20.499340 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-9cd557a7-f277-42fe-99db-1cf5353a8098 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:20.499958 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-9cd557a7-f277-42fe-99db-1cf5353a8098 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:20.513626 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-9cd557a7-f277-42fe-99db-1cf5353a8098 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:20.515441 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-9cd557a7-f277-42fe-99db-1cf5353a8098 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:20.517113 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-9cd557a7-f277-42fe-99db-1cf5353a8098 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:20.517909 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-9cd557a7-f277-42fe-99db-1cf5353a8098 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:20.565412 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-8c75aa86-67d7-4d1b-9c7f-eda19e26b7fb tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:20.577974 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-8c75aa86-67d7-4d1b-9c7f-eda19e26b7fb tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1321 microversion: 2.1 time: 0.313941 Jan 18 16:30:20.582573 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 30/64] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:20 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1321 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:30:21.025736 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-9cd557a7-f277-42fe-99db-1cf5353a8098 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:21.044819 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-9cd557a7-f277-42fe-99db-1cf5353a8098 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:21.048261 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-9cd557a7-f277-42fe-99db-1cf5353a8098 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:21.058554 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-9cd557a7-f277-42fe-99db-1cf5353a8098 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1407 microversion: 2.20 time: 0.569268 Jan 18 16:30:21.062067 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 35/65] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:30:20 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1407 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:30:21.159299 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-9133a255-7458-4873-9608-bb1536952503 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:21.160007 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-9133a255-7458-4873-9608-bb1536952503 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] [instance: 989d2f30-5220-48b9-99b1-743321171593] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:21.180787 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-9133a255-7458-4873-9608-bb1536952503 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:21.181441 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-9133a255-7458-4873-9608-bb1536952503 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:21.182943 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-9133a255-7458-4873-9608-bb1536952503 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:21.185194 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-9133a255-7458-4873-9608-bb1536952503 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:21.596172 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-da4dbf65-2f33-4db6-9ab1-516bb7d3a470 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:21.596792 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-da4dbf65-2f33-4db6-9ab1-516bb7d3a470 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:21.605097 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-da4dbf65-2f33-4db6-9ab1-516bb7d3a470 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:21.606142 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-da4dbf65-2f33-4db6-9ab1-516bb7d3a470 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:21.606348 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-da4dbf65-2f33-4db6-9ab1-516bb7d3a470 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:21.606785 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-da4dbf65-2f33-4db6-9ab1-516bb7d3a470 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:21.838532 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-9133a255-7458-4873-9608-bb1536952503 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441a94d1e434168a4563c2ed04adf12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b205cbc85b42462e9fb91e126616d33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:21.854444 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-9133a255-7458-4873-9608-bb1536952503 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] 10.222.0.82 "GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593" status: 200 len: 1315 microversion: 2.1 time: 0.699709 Jan 18 16:30:21.869002 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 31/66] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:21 2022] GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593 => generated 1315 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:30:22.051282 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-da4dbf65-2f33-4db6-9ab1-516bb7d3a470 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:22.066804 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-da4dbf65-2f33-4db6-9ab1-516bb7d3a470 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1321 microversion: 2.1 time: 0.474162 Jan 18 16:30:22.067761 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 36/67] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:21 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1321 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:30:22.082032 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-12e6b19a-4338-411b-bf4b-e9a84a0d6823 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:22.082655 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-12e6b19a-4338-411b-bf4b-e9a84a0d6823 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:22.090574 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-12e6b19a-4338-411b-bf4b-e9a84a0d6823 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:22.092409 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-12e6b19a-4338-411b-bf4b-e9a84a0d6823 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:22.093938 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-12e6b19a-4338-411b-bf4b-e9a84a0d6823 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:22.095340 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-12e6b19a-4338-411b-bf4b-e9a84a0d6823 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:22.201121 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [req-fd6ead46-befb-44d1-93e8-054d7eb775a5 req-883ea517-5766-4161-8afb-6d688ebfb11a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81185063-e397-4416-9d88-33fd33859fe1", "tag": "11d4eb96-5b48-447f-b96d-d55d1869150b"}]} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:30:22.203430 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:30:22.203430 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: warnings.warn(msg) Jan 18 16:30:22.231070 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-fd6ead46-befb-44d1-93e8-054d7eb775a5 req-883ea517-5766-4161-8afb-6d688ebfb11a service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:22.231515 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-fd6ead46-befb-44d1-93e8-054d7eb775a5 req-883ea517-5766-4161-8afb-6d688ebfb11a service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:22.277803 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.compute.server_external_events [req-fd6ead46-befb-44d1-93e8-054d7eb775a5 req-883ea517-5766-4161-8afb-6d688ebfb11a service nova] Creating event network-changed:11d4eb96-5b48-447f-b96d-d55d1869150b for instance 81185063-e397-4416-9d88-33fd33859fe1 on hv-cinder-78836 Jan 18 16:30:22.278337 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-fd6ead46-befb-44d1-93e8-054d7eb775a5 req-883ea517-5766-4161-8afb-6d688ebfb11a service nova] Acquired lock "compute-rpcapi-router" {{(pid=116367) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 18 16:30:22.279473 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-50502947-b356-4acf-aa9f-f1185799c977 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:22.279901 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-50502947-b356-4acf-aa9f-f1185799c977 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:22.280684 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-50502947-b356-4acf-aa9f-f1185799c977 None None] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:22.290138 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-50502947-b356-4acf-aa9f-f1185799c977 None None] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:22.318715 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.compute.rpcapi [None req-50502947-b356-4acf-aa9f-f1185799c977 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 18 16:30:22.320765 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-50502947-b356-4acf-aa9f-f1185799c977 None None] Releasing lock "compute-rpcapi-router" {{(pid=116367) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 18 16:30:22.362090 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-50502947-b356-4acf-aa9f-f1185799c977 None None] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164575 Jan 18 16:30:22.363052 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 37/68] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:30:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 16:30:22.444211 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-12e6b19a-4338-411b-bf4b-e9a84a0d6823 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:22.460016 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-12e6b19a-4338-411b-bf4b-e9a84a0d6823 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:22.476056 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-12e6b19a-4338-411b-bf4b-e9a84a0d6823 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:22.476889 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-12e6b19a-4338-411b-bf4b-e9a84a0d6823 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1407 microversion: 2.20 time: 0.400590 Jan 18 16:30:22.477816 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 32/69] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:30:22 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1407 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 16:30:22.875820 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-c40b8652-881c-4051-8e78-f0413ae42a46 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:22.877965 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-c40b8652-881c-4051-8e78-f0413ae42a46 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] [instance: 989d2f30-5220-48b9-99b1-743321171593] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:22.892119 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c40b8652-881c-4051-8e78-f0413ae42a46 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:22.892656 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c40b8652-881c-4051-8e78-f0413ae42a46 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:22.896970 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c40b8652-881c-4051-8e78-f0413ae42a46 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:22.897585 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c40b8652-881c-4051-8e78-f0413ae42a46 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:23.123802 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-c40b8652-881c-4051-8e78-f0413ae42a46 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441a94d1e434168a4563c2ed04adf12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b205cbc85b42462e9fb91e126616d33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:23.132193 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-c40b8652-881c-4051-8e78-f0413ae42a46 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] 10.222.0.82 "GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593" status: 200 len: 1315 microversion: 2.1 time: 0.262007 Jan 18 16:30:23.133172 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 38/70] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:22 2022] GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593 => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:30:23.138420 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-78d857a1-157b-4741-8ddd-40f3f520e4aa tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:23.139127 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-78d857a1-157b-4741-8ddd-40f3f520e4aa tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:23.146801 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-78d857a1-157b-4741-8ddd-40f3f520e4aa tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:23.147312 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-78d857a1-157b-4741-8ddd-40f3f520e4aa tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:23.148106 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-78d857a1-157b-4741-8ddd-40f3f520e4aa tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:23.148541 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-78d857a1-157b-4741-8ddd-40f3f520e4aa tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:23.192656 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [req-fc2003bb-bdc8-4a00-9a36-0a851c0f7411 req-4bbb5410-2a16-437b-9401-3fd64f8c1233 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e9ca525-aad0-4ac6-8879-2c8d0131c2ee", "tag": "ca2a0420-8660-4c5a-8bc5-c3d7fa2913eb"}]} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:30:23.195602 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:30:23.195602 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: warnings.warn(msg) Jan 18 16:30:23.207172 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-fc2003bb-bdc8-4a00-9a36-0a851c0f7411 req-4bbb5410-2a16-437b-9401-3fd64f8c1233 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:23.208051 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-fc2003bb-bdc8-4a00-9a36-0a851c0f7411 req-4bbb5410-2a16-437b-9401-3fd64f8c1233 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:23.222794 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.compute.server_external_events [req-fc2003bb-bdc8-4a00-9a36-0a851c0f7411 req-4bbb5410-2a16-437b-9401-3fd64f8c1233 service nova] Creating event network-changed:ca2a0420-8660-4c5a-8bc5-c3d7fa2913eb for instance 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee on hv-cinder-78836 Jan 18 16:30:23.228643 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [req-fc2003bb-bdc8-4a00-9a36-0a851c0f7411 req-4bbb5410-2a16-437b-9401-3fd64f8c1233 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.244143 Jan 18 16:30:23.230129 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 33/71] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:30:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 16:30:23.335932 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-78d857a1-157b-4741-8ddd-40f3f520e4aa tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:23.345813 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-78d857a1-157b-4741-8ddd-40f3f520e4aa tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1321 microversion: 2.1 time: 0.209154 Jan 18 16:30:23.347518 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 39/72] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:23 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1321 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:30:23.500337 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-3ddedfb2-315d-4aaa-8e79-7a48d6b25577 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:23.501648 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-3ddedfb2-315d-4aaa-8e79-7a48d6b25577 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:23.510887 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3ddedfb2-315d-4aaa-8e79-7a48d6b25577 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:23.511641 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3ddedfb2-315d-4aaa-8e79-7a48d6b25577 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:23.512688 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3ddedfb2-315d-4aaa-8e79-7a48d6b25577 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:23.513313 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3ddedfb2-315d-4aaa-8e79-7a48d6b25577 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:23.696527 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-3ddedfb2-315d-4aaa-8e79-7a48d6b25577 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:23.705672 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-3ddedfb2-315d-4aaa-8e79-7a48d6b25577 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:23.708415 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-3ddedfb2-315d-4aaa-8e79-7a48d6b25577 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:23.709580 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-3ddedfb2-315d-4aaa-8e79-7a48d6b25577 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1407 microversion: 2.20 time: 0.217375 Jan 18 16:30:23.710394 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 34/73] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:30:23 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 16:30:24.149472 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-3655470c-8dc2-4761-9722-7e88f030ead5 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:24.150175 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-3655470c-8dc2-4761-9722-7e88f030ead5 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] [instance: 989d2f30-5220-48b9-99b1-743321171593] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:24.160439 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-3655470c-8dc2-4761-9722-7e88f030ead5 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:24.161219 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-3655470c-8dc2-4761-9722-7e88f030ead5 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:24.162329 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-3655470c-8dc2-4761-9722-7e88f030ead5 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:24.165219 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-3655470c-8dc2-4761-9722-7e88f030ead5 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:24.364031 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-4e6116ea-bc48-4a49-be4d-6177b98915f4 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:24.364663 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-4e6116ea-bc48-4a49-be4d-6177b98915f4 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:24.372142 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4e6116ea-bc48-4a49-be4d-6177b98915f4 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:24.372594 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4e6116ea-bc48-4a49-be4d-6177b98915f4 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:24.379245 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4e6116ea-bc48-4a49-be4d-6177b98915f4 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:24.379766 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4e6116ea-bc48-4a49-be4d-6177b98915f4 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:24.544882 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-3655470c-8dc2-4761-9722-7e88f030ead5 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441a94d1e434168a4563c2ed04adf12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b205cbc85b42462e9fb91e126616d33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:24.570309 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-3655470c-8dc2-4761-9722-7e88f030ead5 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] 10.222.0.82 "GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593" status: 200 len: 1315 microversion: 2.1 time: 0.424285 Jan 18 16:30:24.571868 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 40/74] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:24 2022] GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593 => generated 1315 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:30:24.728036 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-1d6f8d5f-a991-43a3-a686-acc3421ca171 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:24.729188 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-1d6f8d5f-a991-43a3-a686-acc3421ca171 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:24.737094 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-1d6f8d5f-a991-43a3-a686-acc3421ca171 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:24.738931 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-1d6f8d5f-a991-43a3-a686-acc3421ca171 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:24.739876 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-1d6f8d5f-a991-43a3-a686-acc3421ca171 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:24.740840 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-1d6f8d5f-a991-43a3-a686-acc3421ca171 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:25.207611 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-4e6116ea-bc48-4a49-be4d-6177b98915f4 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:25.217755 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-4e6116ea-bc48-4a49-be4d-6177b98915f4 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1321 microversion: 2.1 time: 0.859060 Jan 18 16:30:25.232610 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 35/75] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:24 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1321 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:30:25.520605 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-1d6f8d5f-a991-43a3-a686-acc3421ca171 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:25.529158 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-1d6f8d5f-a991-43a3-a686-acc3421ca171 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:25.530980 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-1d6f8d5f-a991-43a3-a686-acc3421ca171 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:25.532680 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-1d6f8d5f-a991-43a3-a686-acc3421ca171 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1407 microversion: 2.20 time: 0.808379 Jan 18 16:30:25.533868 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 41/76] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:30:24 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1407 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 16:30:25.588235 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-d8d7b780-1f8e-4d83-96bd-f873b00d307d tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:25.589828 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-d8d7b780-1f8e-4d83-96bd-f873b00d307d tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] [instance: 989d2f30-5220-48b9-99b1-743321171593] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:25.601486 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d8d7b780-1f8e-4d83-96bd-f873b00d307d tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:25.602297 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d8d7b780-1f8e-4d83-96bd-f873b00d307d tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:25.604580 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d8d7b780-1f8e-4d83-96bd-f873b00d307d tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:25.606774 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d8d7b780-1f8e-4d83-96bd-f873b00d307d tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:26.154166 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-d8d7b780-1f8e-4d83-96bd-f873b00d307d tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441a94d1e434168a4563c2ed04adf12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b205cbc85b42462e9fb91e126616d33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:26.164592 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-d8d7b780-1f8e-4d83-96bd-f873b00d307d tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] 10.222.0.82 "GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593" status: 200 len: 1315 microversion: 2.1 time: 0.580653 Jan 18 16:30:26.165515 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 36/77] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:25 2022] GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593 => generated 1315 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:30:26.242661 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-4bd3431a-31e2-4c57-aa12-d98c4ebaf280 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:26.243160 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-4bd3431a-31e2-4c57-aa12-d98c4ebaf280 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:26.265165 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4bd3431a-31e2-4c57-aa12-d98c4ebaf280 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:26.265652 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4bd3431a-31e2-4c57-aa12-d98c4ebaf280 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:26.266485 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4bd3431a-31e2-4c57-aa12-d98c4ebaf280 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:26.266977 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4bd3431a-31e2-4c57-aa12-d98c4ebaf280 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:26.534495 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-4bd3431a-31e2-4c57-aa12-d98c4ebaf280 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:26.549385 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-4bd3431a-31e2-4c57-aa12-d98c4ebaf280 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1321 microversion: 2.1 time: 0.310124 Jan 18 16:30:26.551816 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 42/78] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:26 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1321 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:30:26.555253 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-10f5250a-eca0-4ac9-b983-7bd99f5293bf tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:26.555952 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-10f5250a-eca0-4ac9-b983-7bd99f5293bf tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:26.562378 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-10f5250a-eca0-4ac9-b983-7bd99f5293bf tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:26.566292 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-10f5250a-eca0-4ac9-b983-7bd99f5293bf tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:26.568501 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-10f5250a-eca0-4ac9-b983-7bd99f5293bf tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:26.569120 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-10f5250a-eca0-4ac9-b983-7bd99f5293bf tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:26.815765 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-10f5250a-eca0-4ac9-b983-7bd99f5293bf tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:26.834446 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-10f5250a-eca0-4ac9-b983-7bd99f5293bf tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:26.840980 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-10f5250a-eca0-4ac9-b983-7bd99f5293bf tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:26.842057 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-10f5250a-eca0-4ac9-b983-7bd99f5293bf tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1407 microversion: 2.20 time: 0.291684 Jan 18 16:30:26.850014 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 37/79] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:30:26 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1407 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:30:26.988749 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [req-509409ce-e066-4600-af3e-a2d957102e9e req-d21b1936-0cb2-43ac-9dcf-1e275a1ab273 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "989d2f30-5220-48b9-99b1-743321171593", "name": "network-vif-plugged", "status": "completed", "tag": "ce661267-6290-428f-af8d-cd5d03d770e2"}]} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:30:26.990881 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:30:26.990881 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: warnings.warn(msg) Jan 18 16:30:26.998092 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-509409ce-e066-4600-af3e-a2d957102e9e req-d21b1936-0cb2-43ac-9dcf-1e275a1ab273 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:26.998537 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-509409ce-e066-4600-af3e-a2d957102e9e req-d21b1936-0cb2-43ac-9dcf-1e275a1ab273 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:27.010613 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.compute.server_external_events [req-509409ce-e066-4600-af3e-a2d957102e9e req-d21b1936-0cb2-43ac-9dcf-1e275a1ab273 service nova] Creating event network-vif-plugged:ce661267-6290-428f-af8d-cd5d03d770e2 for instance 989d2f30-5220-48b9-99b1-743321171593 on hv-cinder-78836 Jan 18 16:30:27.016327 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [req-509409ce-e066-4600-af3e-a2d957102e9e req-d21b1936-0cb2-43ac-9dcf-1e275a1ab273 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100308 Jan 18 16:30:27.017447 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 43/80] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 16:30:27.181267 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-080465d1-0f6e-403b-a183-1badb45c764f tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:27.181866 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-080465d1-0f6e-403b-a183-1badb45c764f tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] [instance: 989d2f30-5220-48b9-99b1-743321171593] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:27.188519 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-080465d1-0f6e-403b-a183-1badb45c764f tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:27.189155 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-080465d1-0f6e-403b-a183-1badb45c764f tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:27.190075 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-080465d1-0f6e-403b-a183-1badb45c764f tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:27.190642 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-080465d1-0f6e-403b-a183-1badb45c764f tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:27.524737 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-080465d1-0f6e-403b-a183-1badb45c764f tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441a94d1e434168a4563c2ed04adf12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b205cbc85b42462e9fb91e126616d33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:27.534224 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-080465d1-0f6e-403b-a183-1badb45c764f tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] 10.222.0.82 "GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593" status: 200 len: 1315 microversion: 2.1 time: 0.356570 Jan 18 16:30:27.535260 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 38/81] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:27 2022] GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593 => generated 1315 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:30:27.570804 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-c1a2dd68-6e27-43d4-8c26-087415dc9e45 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:27.571711 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-c1a2dd68-6e27-43d4-8c26-087415dc9e45 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:27.579713 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c1a2dd68-6e27-43d4-8c26-087415dc9e45 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:27.582797 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c1a2dd68-6e27-43d4-8c26-087415dc9e45 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:27.583161 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c1a2dd68-6e27-43d4-8c26-087415dc9e45 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:27.583737 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c1a2dd68-6e27-43d4-8c26-087415dc9e45 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:27.775814 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-c1a2dd68-6e27-43d4-8c26-087415dc9e45 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:27.793192 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-c1a2dd68-6e27-43d4-8c26-087415dc9e45 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1321 microversion: 2.1 time: 0.227648 Jan 18 16:30:27.794151 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 44/82] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:27 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1321 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:30:27.869549 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-ca074a2d-22a6-4ace-a03d-cee98e50d509 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:27.870891 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-ca074a2d-22a6-4ace-a03d-cee98e50d509 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:27.880262 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ca074a2d-22a6-4ace-a03d-cee98e50d509 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:27.880902 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ca074a2d-22a6-4ace-a03d-cee98e50d509 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:27.882046 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ca074a2d-22a6-4ace-a03d-cee98e50d509 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:27.884652 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ca074a2d-22a6-4ace-a03d-cee98e50d509 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:28.105326 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-ca074a2d-22a6-4ace-a03d-cee98e50d509 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:28.116422 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-ca074a2d-22a6-4ace-a03d-cee98e50d509 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:28.123584 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-ca074a2d-22a6-4ace-a03d-cee98e50d509 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:28.127822 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-ca074a2d-22a6-4ace-a03d-cee98e50d509 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1407 microversion: 2.20 time: 0.260668 Jan 18 16:30:28.130143 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 39/83] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:30:27 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1407 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 16:30:28.556243 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-e93bc35c-fb02-48e3-ae15-763cf2520d70 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:28.558327 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-e93bc35c-fb02-48e3-ae15-763cf2520d70 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] [instance: 989d2f30-5220-48b9-99b1-743321171593] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:28.577448 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e93bc35c-fb02-48e3-ae15-763cf2520d70 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:28.578742 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e93bc35c-fb02-48e3-ae15-763cf2520d70 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:28.580296 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e93bc35c-fb02-48e3-ae15-763cf2520d70 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:28.580952 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e93bc35c-fb02-48e3-ae15-763cf2520d70 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:28.757111 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-e93bc35c-fb02-48e3-ae15-763cf2520d70 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441a94d1e434168a4563c2ed04adf12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b205cbc85b42462e9fb91e126616d33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:28.766715 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-e93bc35c-fb02-48e3-ae15-763cf2520d70 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] 10.222.0.82 "GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593" status: 200 len: 1315 microversion: 2.1 time: 0.214286 Jan 18 16:30:28.775111 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 45/84] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:28 2022] GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:30:28.814591 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-299003e4-b2a0-4b7b-9d27-04da461d28f0 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:28.815694 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-299003e4-b2a0-4b7b-9d27-04da461d28f0 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:28.822832 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-299003e4-b2a0-4b7b-9d27-04da461d28f0 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:28.823489 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-299003e4-b2a0-4b7b-9d27-04da461d28f0 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:28.824445 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-299003e4-b2a0-4b7b-9d27-04da461d28f0 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:28.825068 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-299003e4-b2a0-4b7b-9d27-04da461d28f0 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:29.107880 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-299003e4-b2a0-4b7b-9d27-04da461d28f0 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:29.119299 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-299003e4-b2a0-4b7b-9d27-04da461d28f0 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1321 microversion: 2.1 time: 0.311064 Jan 18 16:30:29.130476 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 40/85] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:28 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1321 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:30:29.148662 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-7ea37ceb-d518-43fc-8641-e48df9655854 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:29.149500 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-7ea37ceb-d518-43fc-8641-e48df9655854 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:29.159185 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7ea37ceb-d518-43fc-8641-e48df9655854 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:29.159952 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7ea37ceb-d518-43fc-8641-e48df9655854 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:29.161232 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7ea37ceb-d518-43fc-8641-e48df9655854 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:29.168334 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7ea37ceb-d518-43fc-8641-e48df9655854 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:29.402100 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-7ea37ceb-d518-43fc-8641-e48df9655854 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:29.416150 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-7ea37ceb-d518-43fc-8641-e48df9655854 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:29.426162 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-7ea37ceb-d518-43fc-8641-e48df9655854 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:29.427772 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-7ea37ceb-d518-43fc-8641-e48df9655854 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1407 microversion: 2.20 time: 0.284191 Jan 18 16:30:29.435932 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 46/86] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:30:29 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1407 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:30:29.789825 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-8c92e35a-6710-4288-8bbe-9d7c756fad67 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:29.790685 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-8c92e35a-6710-4288-8bbe-9d7c756fad67 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] [instance: 989d2f30-5220-48b9-99b1-743321171593] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:29.802158 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8c92e35a-6710-4288-8bbe-9d7c756fad67 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:29.802843 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8c92e35a-6710-4288-8bbe-9d7c756fad67 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:29.803792 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8c92e35a-6710-4288-8bbe-9d7c756fad67 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:29.804372 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8c92e35a-6710-4288-8bbe-9d7c756fad67 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:30.065716 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-8c92e35a-6710-4288-8bbe-9d7c756fad67 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441a94d1e434168a4563c2ed04adf12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b205cbc85b42462e9fb91e126616d33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:30.076977 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-8c92e35a-6710-4288-8bbe-9d7c756fad67 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] 10.222.0.82 "GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593" status: 200 len: 1501 microversion: 2.1 time: 0.293357 Jan 18 16:30:30.077755 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 41/87] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:29 2022] GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593 => generated 1501 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:30:30.139049 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-eaead14c-2e0b-4247-9003-bee6bf04434e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:30.139660 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-eaead14c-2e0b-4247-9003-bee6bf04434e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:30.171912 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-eaead14c-2e0b-4247-9003-bee6bf04434e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:30.172377 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-eaead14c-2e0b-4247-9003-bee6bf04434e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:30.173876 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-eaead14c-2e0b-4247-9003-bee6bf04434e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:30.174386 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-eaead14c-2e0b-4247-9003-bee6bf04434e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:30.480117 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-eaead14c-2e0b-4247-9003-bee6bf04434e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:30.480491 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-f6d0f3e8-5f7a-4187-9cd5-b7dc4432ae5c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:30.480946 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-f6d0f3e8-5f7a-4187-9cd5-b7dc4432ae5c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:30.488691 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-eaead14c-2e0b-4247-9003-bee6bf04434e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1321 microversion: 2.1 time: 0.353810 Jan 18 16:30:30.491389 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 47/88] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:30 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1321 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:30:30.498908 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f6d0f3e8-5f7a-4187-9cd5-b7dc4432ae5c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:30.499969 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f6d0f3e8-5f7a-4187-9cd5-b7dc4432ae5c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:30.501501 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f6d0f3e8-5f7a-4187-9cd5-b7dc4432ae5c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:30.502175 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f6d0f3e8-5f7a-4187-9cd5-b7dc4432ae5c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:30.915435 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-f6d0f3e8-5f7a-4187-9cd5-b7dc4432ae5c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:30.935181 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-f6d0f3e8-5f7a-4187-9cd5-b7dc4432ae5c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:30.940775 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-f6d0f3e8-5f7a-4187-9cd5-b7dc4432ae5c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:30.943189 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-f6d0f3e8-5f7a-4187-9cd5-b7dc4432ae5c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1407 microversion: 2.20 time: 0.493214 Jan 18 16:30:30.944050 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 42/89] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:30:30 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1407 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:30:31.053156 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [req-114681a9-3644-475a-9257-77fdb48321b3 req-63016ede-eab1-4405-875a-82169b84dc9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c862639d-6995-43e1-9c7a-3d4f416629fc", "name": "network-vif-plugged", "status": "completed", "tag": "26efc157-2c4a-47a9-adb9-526b31015bd6"}]} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:30:31.055574 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:30:31.055574 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: warnings.warn(msg) Jan 18 16:30:31.072067 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-114681a9-3644-475a-9257-77fdb48321b3 req-63016ede-eab1-4405-875a-82169b84dc9a service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:31.073001 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-114681a9-3644-475a-9257-77fdb48321b3 req-63016ede-eab1-4405-875a-82169b84dc9a service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:31.098475 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.compute.server_external_events [req-114681a9-3644-475a-9257-77fdb48321b3 req-63016ede-eab1-4405-875a-82169b84dc9a service nova] Creating event network-vif-plugged:26efc157-2c4a-47a9-adb9-526b31015bd6 for instance c862639d-6995-43e1-9c7a-3d4f416629fc on hv-cinder-78836 Jan 18 16:30:31.103818 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [req-114681a9-3644-475a-9257-77fdb48321b3 req-63016ede-eab1-4405-875a-82169b84dc9a service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054867 Jan 18 16:30:31.104627 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 48/90] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:30:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:30:31.507649 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-fd5a678b-eb5b-4554-9363-ecca16b95762 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:31.508254 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-fd5a678b-eb5b-4554-9363-ecca16b95762 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:31.514668 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-fd5a678b-eb5b-4554-9363-ecca16b95762 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:31.515108 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-fd5a678b-eb5b-4554-9363-ecca16b95762 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:31.515891 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-fd5a678b-eb5b-4554-9363-ecca16b95762 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:31.516318 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-fd5a678b-eb5b-4554-9363-ecca16b95762 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:31.672247 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-fd5a678b-eb5b-4554-9363-ecca16b95762 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:31.681176 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-fd5a678b-eb5b-4554-9363-ecca16b95762 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1321 microversion: 2.1 time: 0.177434 Jan 18 16:30:31.682142 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 43/91] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:31 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1321 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:30:31.961466 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-cffa0f6a-3cf3-44af-81a6-035754f437c0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:31.962932 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-cffa0f6a-3cf3-44af-81a6-035754f437c0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:31.969032 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-cffa0f6a-3cf3-44af-81a6-035754f437c0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:31.969685 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-cffa0f6a-3cf3-44af-81a6-035754f437c0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:31.971039 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-cffa0f6a-3cf3-44af-81a6-035754f437c0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:31.971533 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-cffa0f6a-3cf3-44af-81a6-035754f437c0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:32.145628 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-cffa0f6a-3cf3-44af-81a6-035754f437c0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:32.154565 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-cffa0f6a-3cf3-44af-81a6-035754f437c0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:32.156376 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-cffa0f6a-3cf3-44af-81a6-035754f437c0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:32.157867 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-cffa0f6a-3cf3-44af-81a6-035754f437c0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1407 microversion: 2.20 time: 0.200287 Jan 18 16:30:32.158415 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 49/92] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:30:31 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1407 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:30:32.698242 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-341e36bd-7c6f-40f3-9fd7-4b5613d64514 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:32.699071 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-341e36bd-7c6f-40f3-9fd7-4b5613d64514 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:32.706134 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-341e36bd-7c6f-40f3-9fd7-4b5613d64514 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:32.706661 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-341e36bd-7c6f-40f3-9fd7-4b5613d64514 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:32.707627 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-341e36bd-7c6f-40f3-9fd7-4b5613d64514 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:32.708212 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-341e36bd-7c6f-40f3-9fd7-4b5613d64514 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:32.870131 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-341e36bd-7c6f-40f3-9fd7-4b5613d64514 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:32.881731 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-341e36bd-7c6f-40f3-9fd7-4b5613d64514 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1321 microversion: 2.1 time: 0.187001 Jan 18 16:30:32.882306 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 44/93] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:32 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:30:33.176506 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-63a9b319-abab-4e0e-95a2-ef2be073d6be tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:33.179841 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-63a9b319-abab-4e0e-95a2-ef2be073d6be tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:33.187542 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-63a9b319-abab-4e0e-95a2-ef2be073d6be tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:33.188169 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-63a9b319-abab-4e0e-95a2-ef2be073d6be tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:33.191401 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-63a9b319-abab-4e0e-95a2-ef2be073d6be tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:33.192194 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-63a9b319-abab-4e0e-95a2-ef2be073d6be tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:33.361274 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-63a9b319-abab-4e0e-95a2-ef2be073d6be tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:33.369838 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-63a9b319-abab-4e0e-95a2-ef2be073d6be tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:33.371502 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-63a9b319-abab-4e0e-95a2-ef2be073d6be tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:33.372614 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-63a9b319-abab-4e0e-95a2-ef2be073d6be tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1407 microversion: 2.20 time: 0.200325 Jan 18 16:30:33.373503 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 50/94] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:30:33 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1407 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:30:33.898437 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-24a52fa4-1a58-4a60-8870-0764d798228d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:33.900284 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-24a52fa4-1a58-4a60-8870-0764d798228d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:33.909926 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-24a52fa4-1a58-4a60-8870-0764d798228d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:33.910464 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-24a52fa4-1a58-4a60-8870-0764d798228d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:33.911490 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-24a52fa4-1a58-4a60-8870-0764d798228d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:33.911984 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-24a52fa4-1a58-4a60-8870-0764d798228d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:34.076617 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-dd3f1cc6-6bb6-4310-b74e-87d937b376c4 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "99167bc7-ad8b-499f-8aee-d2b2e21c9907"}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:30:34.078163 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-dd3f1cc6-6bb6-4310-b74e-87d937b376c4 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] [instance: 989d2f30-5220-48b9-99b1-743321171593] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:34.089894 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-dd3f1cc6-6bb6-4310-b74e-87d937b376c4 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:34.090559 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-dd3f1cc6-6bb6-4310-b74e-87d937b376c4 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:34.091342 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-dd3f1cc6-6bb6-4310-b74e-87d937b376c4 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:34.091908 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-dd3f1cc6-6bb6-4310-b74e-87d937b376c4 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:34.102144 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-24a52fa4-1a58-4a60-8870-0764d798228d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:34.113131 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-24a52fa4-1a58-4a60-8870-0764d798228d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1321 microversion: 2.1 time: 0.215458 Jan 18 16:30:34.113131 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 45/95] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:33 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1321 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:30:34.391691 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-3a748e5e-70bd-47ee-ba6d-d221d6deefb0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:34.392317 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-3a748e5e-70bd-47ee-ba6d-d221d6deefb0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:34.401448 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3a748e5e-70bd-47ee-ba6d-d221d6deefb0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:34.402131 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3a748e5e-70bd-47ee-ba6d-d221d6deefb0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:34.403079 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3a748e5e-70bd-47ee-ba6d-d221d6deefb0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:34.403530 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3a748e5e-70bd-47ee-ba6d-d221d6deefb0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:34.592249 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-3a748e5e-70bd-47ee-ba6d-d221d6deefb0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:34.607070 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-3a748e5e-70bd-47ee-ba6d-d221d6deefb0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:34.624471 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-3a748e5e-70bd-47ee-ba6d-d221d6deefb0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:34.630623 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-3a748e5e-70bd-47ee-ba6d-d221d6deefb0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1407 microversion: 2.20 time: 0.241722 Jan 18 16:30:34.633090 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 46/96] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:30:34 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1407 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 16:30:34.969544 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-dd3f1cc6-6bb6-4310-b74e-87d937b376c4 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] 10.222.0.82 "POST /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.899440 Jan 18 16:30:34.971273 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 51/97] 10.222.0.82 () {60 vars in 1322 bytes} [Tue Jan 18 16:30:34 2022] POST /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593/os-volume_attachments => generated 194 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:30:35.131341 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-ce3ab855-e3f0-4cd0-aa5f-c1256de50ad9 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:35.133085 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-ce3ab855-e3f0-4cd0-aa5f-c1256de50ad9 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:35.140822 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ce3ab855-e3f0-4cd0-aa5f-c1256de50ad9 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:35.142360 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ce3ab855-e3f0-4cd0-aa5f-c1256de50ad9 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:35.143280 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ce3ab855-e3f0-4cd0-aa5f-c1256de50ad9 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:35.143712 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ce3ab855-e3f0-4cd0-aa5f-c1256de50ad9 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:35.363005 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-ce3ab855-e3f0-4cd0-aa5f-c1256de50ad9 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:35.381478 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-ce3ab855-e3f0-4cd0-aa5f-c1256de50ad9 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1321 microversion: 2.1 time: 0.257642 Jan 18 16:30:35.382005 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 47/98] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:35 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1321 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:30:35.655485 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-fac810be-e5bf-4cec-adb3-c982096250e6 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:35.656471 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-fac810be-e5bf-4cec-adb3-c982096250e6 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:35.667423 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-fac810be-e5bf-4cec-adb3-c982096250e6 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:35.668090 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-fac810be-e5bf-4cec-adb3-c982096250e6 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:35.669121 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-fac810be-e5bf-4cec-adb3-c982096250e6 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:35.669841 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-fac810be-e5bf-4cec-adb3-c982096250e6 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:35.922575 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-fac810be-e5bf-4cec-adb3-c982096250e6 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:35.932632 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-fac810be-e5bf-4cec-adb3-c982096250e6 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:35.934559 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-fac810be-e5bf-4cec-adb3-c982096250e6 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:35.935686 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-fac810be-e5bf-4cec-adb3-c982096250e6 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1407 microversion: 2.20 time: 0.288605 Jan 18 16:30:35.936237 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 52/99] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:30:35 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1407 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 16:30:36.397610 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-3a8f1c3c-4b0f-46f2-82bf-7d5657cf1e68 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:36.398784 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-3a8f1c3c-4b0f-46f2-82bf-7d5657cf1e68 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:36.409992 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3a8f1c3c-4b0f-46f2-82bf-7d5657cf1e68 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:36.411481 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3a8f1c3c-4b0f-46f2-82bf-7d5657cf1e68 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:36.418023 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3a8f1c3c-4b0f-46f2-82bf-7d5657cf1e68 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:36.418687 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3a8f1c3c-4b0f-46f2-82bf-7d5657cf1e68 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:36.599401 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [req-3c190f01-c298-40b1-967a-c437f7970920 req-321dc97a-df68-43da-b60d-fd6a6d2d8599 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e9ca525-aad0-4ac6-8879-2c8d0131c2ee", "name": "network-vif-plugged", "status": "completed", "tag": "ca2a0420-8660-4c5a-8bc5-c3d7fa2913eb"}]} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:30:36.603092 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:30:36.603092 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: warnings.warn(msg) Jan 18 16:30:36.619883 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-3c190f01-c298-40b1-967a-c437f7970920 req-321dc97a-df68-43da-b60d-fd6a6d2d8599 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:36.620680 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-3c190f01-c298-40b1-967a-c437f7970920 req-321dc97a-df68-43da-b60d-fd6a6d2d8599 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:36.656389 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.compute.server_external_events [req-3c190f01-c298-40b1-967a-c437f7970920 req-321dc97a-df68-43da-b60d-fd6a6d2d8599 service nova] Creating event network-vif-plugged:ca2a0420-8660-4c5a-8bc5-c3d7fa2913eb for instance 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee on hv-cinder-78836 Jan 18 16:30:36.683831 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [req-3c190f01-c298-40b1-967a-c437f7970920 req-321dc97a-df68-43da-b60d-fd6a6d2d8599 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092441 Jan 18 16:30:36.693025 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 53/100] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:30:36.884969 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-3a8f1c3c-4b0f-46f2-82bf-7d5657cf1e68 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:36.895127 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-3a8f1c3c-4b0f-46f2-82bf-7d5657cf1e68 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1321 microversion: 2.1 time: 0.501147 Jan 18 16:30:36.898642 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 48/101] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:36 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1321 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:30:36.961696 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-e362d395-1455-4b8d-a0ea-37ff6938b1df tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:36.962400 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-e362d395-1455-4b8d-a0ea-37ff6938b1df tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:36.982697 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e362d395-1455-4b8d-a0ea-37ff6938b1df tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:36.986547 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e362d395-1455-4b8d-a0ea-37ff6938b1df tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:36.992646 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e362d395-1455-4b8d-a0ea-37ff6938b1df tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:36.993210 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e362d395-1455-4b8d-a0ea-37ff6938b1df tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:37.238851 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-e362d395-1455-4b8d-a0ea-37ff6938b1df tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:37.248353 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-e362d395-1455-4b8d-a0ea-37ff6938b1df tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:37.252955 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-e362d395-1455-4b8d-a0ea-37ff6938b1df tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:37.254480 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-e362d395-1455-4b8d-a0ea-37ff6938b1df tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1407 microversion: 2.20 time: 0.302392 Jan 18 16:30:37.265369 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 54/102] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:30:36 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1407 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:30:37.911798 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-d6c23d27-168f-481e-a7a1-ab3ed35b6519 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:37.913138 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-d6c23d27-168f-481e-a7a1-ab3ed35b6519 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:37.930395 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d6c23d27-168f-481e-a7a1-ab3ed35b6519 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:37.931233 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d6c23d27-168f-481e-a7a1-ab3ed35b6519 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:37.932949 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d6c23d27-168f-481e-a7a1-ab3ed35b6519 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:37.933589 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d6c23d27-168f-481e-a7a1-ab3ed35b6519 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:38.279911 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-4dcb6eb4-a193-4b62-b09d-63a40faf4044 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:38.281627 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-4dcb6eb4-a193-4b62-b09d-63a40faf4044 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:38.287849 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-d6c23d27-168f-481e-a7a1-ab3ed35b6519 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:38.289227 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4dcb6eb4-a193-4b62-b09d-63a40faf4044 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:38.290458 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4dcb6eb4-a193-4b62-b09d-63a40faf4044 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:38.291722 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4dcb6eb4-a193-4b62-b09d-63a40faf4044 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:38.292423 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4dcb6eb4-a193-4b62-b09d-63a40faf4044 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:38.296964 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-d6c23d27-168f-481e-a7a1-ab3ed35b6519 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1321 microversion: 2.1 time: 0.388740 Jan 18 16:30:38.307952 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 49/103] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:37 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1321 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:30:38.507258 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-4dcb6eb4-a193-4b62-b09d-63a40faf4044 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:38.521679 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-4dcb6eb4-a193-4b62-b09d-63a40faf4044 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:38.524148 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-4dcb6eb4-a193-4b62-b09d-63a40faf4044 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:38.526491 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-4dcb6eb4-a193-4b62-b09d-63a40faf4044 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1407 microversion: 2.20 time: 0.256011 Jan 18 16:30:38.528000 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 55/104] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:30:38 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1407 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:30:38.736385 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [req-79368aeb-65cb-478e-b88e-be2af5eaf129 req-00745f6e-a203-4fc3-a158-33e82f00dd54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81185063-e397-4416-9d88-33fd33859fe1", "name": "network-vif-plugged", "status": "completed", "tag": "11d4eb96-5b48-447f-b96d-d55d1869150b"}]} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:30:38.742431 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:30:38.742431 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: warnings.warn(msg) Jan 18 16:30:38.757356 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-79368aeb-65cb-478e-b88e-be2af5eaf129 req-00745f6e-a203-4fc3-a158-33e82f00dd54 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:38.758377 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-79368aeb-65cb-478e-b88e-be2af5eaf129 req-00745f6e-a203-4fc3-a158-33e82f00dd54 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:38.796577 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.compute.server_external_events [req-79368aeb-65cb-478e-b88e-be2af5eaf129 req-00745f6e-a203-4fc3-a158-33e82f00dd54 service nova] Creating event network-vif-plugged:11d4eb96-5b48-447f-b96d-d55d1869150b for instance 81185063-e397-4416-9d88-33fd33859fe1 on hv-cinder-78836 Jan 18 16:30:38.816312 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [req-79368aeb-65cb-478e-b88e-be2af5eaf129 req-00745f6e-a203-4fc3-a158-33e82f00dd54 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091901 Jan 18 16:30:38.819379 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 50/105] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:30:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:30:39.313988 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-2230512e-87ea-4e69-8818-f1f5d61fe3cf tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:39.315322 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-2230512e-87ea-4e69-8818-f1f5d61fe3cf tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:39.325698 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2230512e-87ea-4e69-8818-f1f5d61fe3cf tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:39.326150 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2230512e-87ea-4e69-8818-f1f5d61fe3cf tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:39.326989 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2230512e-87ea-4e69-8818-f1f5d61fe3cf tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:39.327411 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2230512e-87ea-4e69-8818-f1f5d61fe3cf tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:39.524974 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-2230512e-87ea-4e69-8818-f1f5d61fe3cf tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:39.535257 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-2230512e-87ea-4e69-8818-f1f5d61fe3cf tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1321 microversion: 2.1 time: 0.225365 Jan 18 16:30:39.536470 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 56/106] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:39 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1321 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:30:39.549684 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-2f410e9a-7645-40ac-8d1f-0a4076b7efa6 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:39.562563 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-2f410e9a-7645-40ac-8d1f-0a4076b7efa6 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:39.581003 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-2f410e9a-7645-40ac-8d1f-0a4076b7efa6 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:39.582364 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-2f410e9a-7645-40ac-8d1f-0a4076b7efa6 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:39.583628 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-2f410e9a-7645-40ac-8d1f-0a4076b7efa6 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:39.584198 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-2f410e9a-7645-40ac-8d1f-0a4076b7efa6 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:39.746829 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-2f410e9a-7645-40ac-8d1f-0a4076b7efa6 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:39.756272 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-2f410e9a-7645-40ac-8d1f-0a4076b7efa6 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:39.757864 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-2f410e9a-7645-40ac-8d1f-0a4076b7efa6 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:39.759031 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-2f410e9a-7645-40ac-8d1f-0a4076b7efa6 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1407 microversion: 2.20 time: 0.215630 Jan 18 16:30:39.759657 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 51/107] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:30:39 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1407 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:30:40.552205 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-b7681d88-7649-4f19-89e1-f67ca940e4d3 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:40.552741 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-b7681d88-7649-4f19-89e1-f67ca940e4d3 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:40.563357 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-b7681d88-7649-4f19-89e1-f67ca940e4d3 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:40.564372 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-b7681d88-7649-4f19-89e1-f67ca940e4d3 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:40.565214 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-b7681d88-7649-4f19-89e1-f67ca940e4d3 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:40.565659 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-b7681d88-7649-4f19-89e1-f67ca940e4d3 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:40.777447 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-24ec8f96-9131-4c76-bac9-9d5588cb71cb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:40.778047 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-24ec8f96-9131-4c76-bac9-9d5588cb71cb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:40.789449 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-24ec8f96-9131-4c76-bac9-9d5588cb71cb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:40.795169 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-24ec8f96-9131-4c76-bac9-9d5588cb71cb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:40.796656 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-24ec8f96-9131-4c76-bac9-9d5588cb71cb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:40.797134 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-24ec8f96-9131-4c76-bac9-9d5588cb71cb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:40.810406 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-b7681d88-7649-4f19-89e1-f67ca940e4d3 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:40.823198 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-b7681d88-7649-4f19-89e1-f67ca940e4d3 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1321 microversion: 2.1 time: 0.274723 Jan 18 16:30:40.824183 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 57/108] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:40 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1321 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:30:41.021671 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-24ec8f96-9131-4c76-bac9-9d5588cb71cb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:41.030925 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-24ec8f96-9131-4c76-bac9-9d5588cb71cb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:41.033604 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-24ec8f96-9131-4c76-bac9-9d5588cb71cb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:41.035038 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-24ec8f96-9131-4c76-bac9-9d5588cb71cb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1599 microversion: 2.20 time: 0.261245 Jan 18 16:30:41.035759 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 52/109] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:30:40 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1599 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:30:41.053281 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-325424da-193b-486a-9475-5056f2df821a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:41.053824 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-325424da-193b-486a-9475-5056f2df821a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:41.060389 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-325424da-193b-486a-9475-5056f2df821a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:41.061137 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-325424da-193b-486a-9475-5056f2df821a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:41.062206 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-325424da-193b-486a-9475-5056f2df821a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:41.062823 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-325424da-193b-486a-9475-5056f2df821a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:41.193575 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-325424da-193b-486a-9475-5056f2df821a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.143308 Jan 18 16:30:41.195197 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 58/110] 10.222.0.82 () {60 vars in 1315 bytes} [Tue Jan 18 16:30:41 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/os-interface => generated 284 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 18 16:30:41.839212 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-5bf48513-1e06-4599-832d-5578a7bec35e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:41.839820 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-5bf48513-1e06-4599-832d-5578a7bec35e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:41.846253 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-5bf48513-1e06-4599-832d-5578a7bec35e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:41.846886 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-5bf48513-1e06-4599-832d-5578a7bec35e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:41.848050 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-5bf48513-1e06-4599-832d-5578a7bec35e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:41.848638 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-5bf48513-1e06-4599-832d-5578a7bec35e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:42.003368 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-5bf48513-1e06-4599-832d-5578a7bec35e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:42.011077 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-5bf48513-1e06-4599-832d-5578a7bec35e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1321 microversion: 2.1 time: 0.175449 Jan 18 16:30:42.020968 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 53/111] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:41 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:30:42.709137 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-977b76e5-1482-451b-9c6d-0c46c19dc496 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:30:42.710260 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-977b76e5-1482-451b-9c6d-0c46c19dc496 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:42.711971 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [req-8dadeb41-fc54-4770-a522-59cf89261960 req-49d2cb67-95fa-44bc-acc1-26fcbcca3f81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e9ca525-aad0-4ac6-8879-2c8d0131c2ee", "tag": "ca2a0420-8660-4c5a-8bc5-c3d7fa2913eb"}]} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:30:42.713555 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:30:42.713555 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: warnings.warn(msg) Jan 18 16:30:42.716582 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-977b76e5-1482-451b-9c6d-0c46c19dc496 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:42.717068 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-977b76e5-1482-451b-9c6d-0c46c19dc496 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:42.717858 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-977b76e5-1482-451b-9c6d-0c46c19dc496 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:42.718297 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-977b76e5-1482-451b-9c6d-0c46c19dc496 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:42.734286 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-8dadeb41-fc54-4770-a522-59cf89261960 req-49d2cb67-95fa-44bc-acc1-26fcbcca3f81 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:42.734738 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-8dadeb41-fc54-4770-a522-59cf89261960 req-49d2cb67-95fa-44bc-acc1-26fcbcca3f81 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:42.754516 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.compute.server_external_events [req-8dadeb41-fc54-4770-a522-59cf89261960 req-49d2cb67-95fa-44bc-acc1-26fcbcca3f81 service nova] Creating event network-changed:ca2a0420-8660-4c5a-8bc5-c3d7fa2913eb for instance 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee on hv-cinder-78836 Jan 18 16:30:42.768152 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [req-8dadeb41-fc54-4770-a522-59cf89261960 req-49d2cb67-95fa-44bc-acc1-26fcbcca3f81 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059605 Jan 18 16:30:42.768754 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 54/112] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 16:30:42.867400 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-977b76e5-1482-451b-9c6d-0c46c19dc496 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action" status: 200 len: 14 microversion: 2.20 time: 0.162497 Jan 18 16:30:42.870609 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 59/113] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:30:42 2022] POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action => generated 14 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:30:43.029454 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-13b6e56d-7fc6-46ff-982d-21b85c05231b tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:43.030779 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-13b6e56d-7fc6-46ff-982d-21b85c05231b tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:43.037700 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-13b6e56d-7fc6-46ff-982d-21b85c05231b tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:43.038361 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-13b6e56d-7fc6-46ff-982d-21b85c05231b tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:43.039752 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-13b6e56d-7fc6-46ff-982d-21b85c05231b tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:43.040373 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-13b6e56d-7fc6-46ff-982d-21b85c05231b tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:43.371491 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-13b6e56d-7fc6-46ff-982d-21b85c05231b tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:43.386695 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-13b6e56d-7fc6-46ff-982d-21b85c05231b tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1321 microversion: 2.1 time: 0.361409 Jan 18 16:30:43.388661 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 55/114] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:43 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1321 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:30:43.879897 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-a4b1c1b4-f2e8-4aa5-9257-b7c2ddd705ce tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:30:43.881594 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-a4b1c1b4-f2e8-4aa5-9257-b7c2ddd705ce tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:43.897007 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a4b1c1b4-f2e8-4aa5-9257-b7c2ddd705ce tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:43.898034 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a4b1c1b4-f2e8-4aa5-9257-b7c2ddd705ce tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:43.898325 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a4b1c1b4-f2e8-4aa5-9257-b7c2ddd705ce tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:43.902521 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a4b1c1b4-f2e8-4aa5-9257-b7c2ddd705ce tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:44.054893 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-a4b1c1b4-f2e8-4aa5-9257-b7c2ddd705ce tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action" status: 200 len: 14 microversion: 2.20 time: 0.176029 Jan 18 16:30:44.058812 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 60/115] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:30:43 2022] POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action => generated 14 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:30:44.405297 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-e2ee056c-6941-41b1-9296-e02ca1f5bbb6 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:44.405921 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-e2ee056c-6941-41b1-9296-e02ca1f5bbb6 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:44.412074 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e2ee056c-6941-41b1-9296-e02ca1f5bbb6 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:44.412533 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e2ee056c-6941-41b1-9296-e02ca1f5bbb6 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:44.413377 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e2ee056c-6941-41b1-9296-e02ca1f5bbb6 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:44.413810 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e2ee056c-6941-41b1-9296-e02ca1f5bbb6 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:44.559598 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-e2ee056c-6941-41b1-9296-e02ca1f5bbb6 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:44.567774 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-e2ee056c-6941-41b1-9296-e02ca1f5bbb6 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1514 microversion: 2.1 time: 0.166204 Jan 18 16:30:44.568344 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 56/116] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:44 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:30:44.584946 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-40eab016-a53a-4609-ae94-6fc55505a77c tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:30:44.585716 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-40eab016-a53a-4609-ae94-6fc55505a77c tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:44.592343 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-40eab016-a53a-4609-ae94-6fc55505a77c tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:44.592773 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-40eab016-a53a-4609-ae94-6fc55505a77c tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:44.593557 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-40eab016-a53a-4609-ae94-6fc55505a77c tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:44.593980 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-40eab016-a53a-4609-ae94-6fc55505a77c tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:44.619768 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.objects.instance [None req-40eab016-a53a-4609-ae94-6fc55505a77c tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lazy-loading 'flavor' on Instance uuid 81185063-e397-4416-9d88-33fd33859fe1 {{(pid=116367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 18 16:30:44.743244 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-40eab016-a53a-4609-ae94-6fc55505a77c tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "POST /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1/action" status: 200 len: 32 microversion: 2.1 time: 0.162697 Jan 18 16:30:44.743870 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 61/117] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:30:44 2022] POST /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1/action => generated 32 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 18 16:30:44.753070 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-bc8c15e7-5e64-4b6c-809b-90b30528b566 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:44.753952 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-bc8c15e7-5e64-4b6c-809b-90b30528b566 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:44.760013 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-bc8c15e7-5e64-4b6c-809b-90b30528b566 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:44.760454 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-bc8c15e7-5e64-4b6c-809b-90b30528b566 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:44.761775 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-bc8c15e7-5e64-4b6c-809b-90b30528b566 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:44.762367 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-bc8c15e7-5e64-4b6c-809b-90b30528b566 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:44.983545 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-bc8c15e7-5e64-4b6c-809b-90b30528b566 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:44.991774 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-bc8c15e7-5e64-4b6c-809b-90b30528b566 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1520 microversion: 2.1 time: 0.242924 Jan 18 16:30:44.992515 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 57/118] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:44 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1520 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:30:45.069059 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-0b79189a-d34c-4179-b70d-e11adb72916d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:30:45.071108 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-0b79189a-d34c-4179-b70d-e11adb72916d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:45.077927 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0b79189a-d34c-4179-b70d-e11adb72916d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:45.079233 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0b79189a-d34c-4179-b70d-e11adb72916d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:45.080735 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0b79189a-d34c-4179-b70d-e11adb72916d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:45.081718 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0b79189a-d34c-4179-b70d-e11adb72916d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:45.206217 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-0b79189a-d34c-4179-b70d-e11adb72916d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action" status: 200 len: 14 microversion: 2.20 time: 0.142496 Jan 18 16:30:45.207205 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 62/119] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:30:45 2022] POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action => generated 14 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:30:46.008831 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-92172ca5-fd80-44e9-ab82-6da47ca06526 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:46.009463 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-92172ca5-fd80-44e9-ab82-6da47ca06526 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:46.016375 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-92172ca5-fd80-44e9-ab82-6da47ca06526 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:46.017408 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-92172ca5-fd80-44e9-ab82-6da47ca06526 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:46.018294 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-92172ca5-fd80-44e9-ab82-6da47ca06526 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:46.018666 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-92172ca5-fd80-44e9-ab82-6da47ca06526 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:46.150997 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-f195a49a-72f9-402c-a94a-dfb37fdc81b1 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:46.152457 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-f195a49a-72f9-402c-a94a-dfb37fdc81b1 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] [instance: 989d2f30-5220-48b9-99b1-743321171593] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:46.160843 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-f195a49a-72f9-402c-a94a-dfb37fdc81b1 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:46.161487 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-f195a49a-72f9-402c-a94a-dfb37fdc81b1 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:46.162671 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-f195a49a-72f9-402c-a94a-dfb37fdc81b1 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:46.163281 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-f195a49a-72f9-402c-a94a-dfb37fdc81b1 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:46.170936 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-92172ca5-fd80-44e9-ab82-6da47ca06526 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:46.181294 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-92172ca5-fd80-44e9-ab82-6da47ca06526 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1520 microversion: 2.1 time: 0.175562 Jan 18 16:30:46.182271 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 58/120] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:46 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:30:46.224908 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-165ce399-2865-4dda-bec9-2bc9e7e9afbd tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:30:46.226120 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-165ce399-2865-4dda-bec9-2bc9e7e9afbd tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:46.242635 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-165ce399-2865-4dda-bec9-2bc9e7e9afbd tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:46.242946 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-165ce399-2865-4dda-bec9-2bc9e7e9afbd tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:46.243821 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-165ce399-2865-4dda-bec9-2bc9e7e9afbd tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:46.244332 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-165ce399-2865-4dda-bec9-2bc9e7e9afbd tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:46.399553 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-f195a49a-72f9-402c-a94a-dfb37fdc81b1 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] [instance: 989d2f30-5220-48b9-99b1-743321171593] Going to try to terminate instance {{(pid=116367) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 18 16:30:46.491446 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-f195a49a-72f9-402c-a94a-dfb37fdc81b1 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] 10.222.0.82 "DELETE /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593" status: 204 len: 0 microversion: 2.1 time: 0.345124 Jan 18 16:30:46.492180 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 63/121] 10.222.0.82 () {58 vars in 1238 bytes} [Tue Jan 18 16:30:46 2022] DELETE /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 18 16:30:46.502676 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-0164b4ec-8a53-4985-9ad3-e15c0c340c32 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:46.503362 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-0164b4ec-8a53-4985-9ad3-e15c0c340c32 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] [instance: 989d2f30-5220-48b9-99b1-743321171593] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:46.509481 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0164b4ec-8a53-4985-9ad3-e15c0c340c32 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:46.510093 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0164b4ec-8a53-4985-9ad3-e15c0c340c32 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:46.511022 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0164b4ec-8a53-4985-9ad3-e15c0c340c32 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:46.511459 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0164b4ec-8a53-4985-9ad3-e15c0c340c32 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:46.658473 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-0164b4ec-8a53-4985-9ad3-e15c0c340c32 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441a94d1e434168a4563c2ed04adf12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b205cbc85b42462e9fb91e126616d33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:46.666460 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-0164b4ec-8a53-4985-9ad3-e15c0c340c32 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] 10.222.0.82 "GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593" status: 200 len: 1553 microversion: 2.1 time: 0.168125 Jan 18 16:30:46.667014 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 64/122] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:46 2022] GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593 => generated 1553 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:30:47.202746 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-20a149ff-fb82-41c6-8395-b32482ac6a4d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:47.203399 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-20a149ff-fb82-41c6-8395-b32482ac6a4d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:47.210425 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-20a149ff-fb82-41c6-8395-b32482ac6a4d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:47.210882 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-20a149ff-fb82-41c6-8395-b32482ac6a4d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:47.211665 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-20a149ff-fb82-41c6-8395-b32482ac6a4d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:47.212104 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-20a149ff-fb82-41c6-8395-b32482ac6a4d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:47.339218 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-20a149ff-fb82-41c6-8395-b32482ac6a4d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:47.347693 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-20a149ff-fb82-41c6-8395-b32482ac6a4d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1520 microversion: 2.1 time: 0.148544 Jan 18 16:30:47.348259 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 65/123] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:47 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:30:47.683209 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-a308dfe1-f6fe-41b6-8744-812bf1d9278b tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:47.683821 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-a308dfe1-f6fe-41b6-8744-812bf1d9278b tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] [instance: 989d2f30-5220-48b9-99b1-743321171593] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:47.689623 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a308dfe1-f6fe-41b6-8744-812bf1d9278b tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:47.690075 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a308dfe1-f6fe-41b6-8744-812bf1d9278b tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:47.690854 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a308dfe1-f6fe-41b6-8744-812bf1d9278b tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:47.691549 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a308dfe1-f6fe-41b6-8744-812bf1d9278b tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:47.821708 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-a308dfe1-f6fe-41b6-8744-812bf1d9278b tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441a94d1e434168a4563c2ed04adf12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b205cbc85b42462e9fb91e126616d33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:47.830066 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-a308dfe1-f6fe-41b6-8744-812bf1d9278b tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] 10.222.0.82 "GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593" status: 200 len: 1553 microversion: 2.1 time: 0.149784 Jan 18 16:30:47.830631 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 66/124] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:47 2022] GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593 => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:30:48.364614 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-4ebd5755-9733-48d8-a9a3-e2b886658f4d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:48.365294 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-4ebd5755-9733-48d8-a9a3-e2b886658f4d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:48.371122 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4ebd5755-9733-48d8-a9a3-e2b886658f4d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:48.371609 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4ebd5755-9733-48d8-a9a3-e2b886658f4d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:48.372384 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4ebd5755-9733-48d8-a9a3-e2b886658f4d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:48.372820 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4ebd5755-9733-48d8-a9a3-e2b886658f4d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:48.504609 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-4ebd5755-9733-48d8-a9a3-e2b886658f4d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:48.511807 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-4ebd5755-9733-48d8-a9a3-e2b886658f4d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1520 microversion: 2.1 time: 0.151599 Jan 18 16:30:48.512373 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 67/125] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:48 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:30:48.847490 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-02b34293-d0b5-4d8f-84a4-7032a1a5eeb1 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:48.848015 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-02b34293-d0b5-4d8f-84a4-7032a1a5eeb1 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] [instance: 989d2f30-5220-48b9-99b1-743321171593] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:48.854303 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-02b34293-d0b5-4d8f-84a4-7032a1a5eeb1 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:48.854752 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-02b34293-d0b5-4d8f-84a4-7032a1a5eeb1 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:48.855530 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-02b34293-d0b5-4d8f-84a4-7032a1a5eeb1 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:48.855965 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-02b34293-d0b5-4d8f-84a4-7032a1a5eeb1 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:48.982505 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-02b34293-d0b5-4d8f-84a4-7032a1a5eeb1 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441a94d1e434168a4563c2ed04adf12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b205cbc85b42462e9fb91e126616d33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:48.990623 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-02b34293-d0b5-4d8f-84a4-7032a1a5eeb1 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] 10.222.0.82 "GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593" status: 200 len: 1553 microversion: 2.1 time: 0.147398 Jan 18 16:30:48.991189 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 68/126] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:48 2022] GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593 => generated 1553 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:30:49.460685 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-165ce399-2865-4dda-bec9-2bc9e7e9afbd tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action" status: 200 len: 14 microversion: 2.20 time: 3.241603 Jan 18 16:30:49.461663 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 59/127] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:30:46 2022] POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action => generated 14 bytes in 3243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:30:49.528704 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-1e23ff24-0759-4505-bb78-671b12e717bb tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:49.529320 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-1e23ff24-0759-4505-bb78-671b12e717bb tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:49.535004 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-1e23ff24-0759-4505-bb78-671b12e717bb tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:49.535454 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-1e23ff24-0759-4505-bb78-671b12e717bb tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:49.536236 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-1e23ff24-0759-4505-bb78-671b12e717bb tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:49.536675 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-1e23ff24-0759-4505-bb78-671b12e717bb tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:49.667537 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-1e23ff24-0759-4505-bb78-671b12e717bb tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:49.675325 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-1e23ff24-0759-4505-bb78-671b12e717bb tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1520 microversion: 2.1 time: 0.150408 Jan 18 16:30:49.675902 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 69/128] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:49 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:30:50.008131 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-8892a086-d065-4eb2-b315-96fcfbbb850f tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:50.008828 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-8892a086-d065-4eb2-b315-96fcfbbb850f tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] [instance: 989d2f30-5220-48b9-99b1-743321171593] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:50.016053 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8892a086-d065-4eb2-b315-96fcfbbb850f tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:50.016493 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8892a086-d065-4eb2-b315-96fcfbbb850f tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:50.017293 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8892a086-d065-4eb2-b315-96fcfbbb850f tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:50.017786 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8892a086-d065-4eb2-b315-96fcfbbb850f tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:50.146183 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-8892a086-d065-4eb2-b315-96fcfbbb850f tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441a94d1e434168a4563c2ed04adf12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b205cbc85b42462e9fb91e126616d33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:50.154964 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-8892a086-d065-4eb2-b315-96fcfbbb850f tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] 10.222.0.82 "GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593" status: 200 len: 1553 microversion: 2.1 time: 0.150665 Jan 18 16:30:50.155446 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 60/129] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:50 2022] GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593 => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:30:50.472085 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-63f08212-4344-4d39-ba17-53e1c7139fd8 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:30:50.473016 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-63f08212-4344-4d39-ba17-53e1c7139fd8 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:50.479259 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-63f08212-4344-4d39-ba17-53e1c7139fd8 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:50.479709 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-63f08212-4344-4d39-ba17-53e1c7139fd8 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:50.480490 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-63f08212-4344-4d39-ba17-53e1c7139fd8 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:50.480937 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-63f08212-4344-4d39-ba17-53e1c7139fd8 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:50.691854 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-404eec28-80b0-4b69-9450-b91c046a3ea2 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:50.692649 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-404eec28-80b0-4b69-9450-b91c046a3ea2 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:50.699064 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-404eec28-80b0-4b69-9450-b91c046a3ea2 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:50.699550 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-404eec28-80b0-4b69-9450-b91c046a3ea2 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:50.700595 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-404eec28-80b0-4b69-9450-b91c046a3ea2 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:50.701126 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-404eec28-80b0-4b69-9450-b91c046a3ea2 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:50.846573 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-404eec28-80b0-4b69-9450-b91c046a3ea2 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:50.857907 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-404eec28-80b0-4b69-9450-b91c046a3ea2 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1520 microversion: 2.1 time: 0.170045 Jan 18 16:30:50.858471 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 61/130] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:50 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:30:51.171999 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-530c59e2-ec48-43fc-8d1e-a85c8dd92916 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:51.172607 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-530c59e2-ec48-43fc-8d1e-a85c8dd92916 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] [instance: 989d2f30-5220-48b9-99b1-743321171593] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:51.179613 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-530c59e2-ec48-43fc-8d1e-a85c8dd92916 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:51.180066 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-530c59e2-ec48-43fc-8d1e-a85c8dd92916 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:51.180851 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-530c59e2-ec48-43fc-8d1e-a85c8dd92916 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:51.181320 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-530c59e2-ec48-43fc-8d1e-a85c8dd92916 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:51.310332 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-530c59e2-ec48-43fc-8d1e-a85c8dd92916 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441a94d1e434168a4563c2ed04adf12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b205cbc85b42462e9fb91e126616d33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:51.320345 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-530c59e2-ec48-43fc-8d1e-a85c8dd92916 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] 10.222.0.82 "GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593" status: 200 len: 1553 microversion: 2.1 time: 0.151848 Jan 18 16:30:51.320928 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 62/131] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:51 2022] GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593 => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:30:51.874333 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-4be1c11c-8aee-437d-8507-743b767125a9 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:51.874988 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-4be1c11c-8aee-437d-8507-743b767125a9 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:51.881306 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4be1c11c-8aee-437d-8507-743b767125a9 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:51.881755 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4be1c11c-8aee-437d-8507-743b767125a9 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:51.882522 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4be1c11c-8aee-437d-8507-743b767125a9 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:51.882947 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4be1c11c-8aee-437d-8507-743b767125a9 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:52.011932 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-4be1c11c-8aee-437d-8507-743b767125a9 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:52.020359 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-4be1c11c-8aee-437d-8507-743b767125a9 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1520 microversion: 2.1 time: 0.149597 Jan 18 16:30:52.021157 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 63/132] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:51 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:30:52.336894 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-a50660c9-39d6-48fe-a41a-37c02acf4067 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:52.337536 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-a50660c9-39d6-48fe-a41a-37c02acf4067 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] [instance: 989d2f30-5220-48b9-99b1-743321171593] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:52.343426 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a50660c9-39d6-48fe-a41a-37c02acf4067 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:52.343877 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a50660c9-39d6-48fe-a41a-37c02acf4067 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:52.344655 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a50660c9-39d6-48fe-a41a-37c02acf4067 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:52.345134 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a50660c9-39d6-48fe-a41a-37c02acf4067 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:52.478118 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-a50660c9-39d6-48fe-a41a-37c02acf4067 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441a94d1e434168a4563c2ed04adf12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b205cbc85b42462e9fb91e126616d33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:52.490341 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-a50660c9-39d6-48fe-a41a-37c02acf4067 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] 10.222.0.82 "GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593" status: 200 len: 1553 microversion: 2.1 time: 0.157002 Jan 18 16:30:52.490930 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 64/133] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:52 2022] GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593 => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:30:53.003306 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-63f08212-4344-4d39-ba17-53e1c7139fd8 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action" status: 200 len: 14 microversion: 2.20 time: 2.534971 Jan 18 16:30:53.004677 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 70/134] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:30:50 2022] POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action => generated 14 bytes in 2537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:30:53.036987 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-667e6736-fc32-46d8-b7f2-3dab30145145 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:53.037599 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-667e6736-fc32-46d8-b7f2-3dab30145145 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:53.043865 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-667e6736-fc32-46d8-b7f2-3dab30145145 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:53.044317 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-667e6736-fc32-46d8-b7f2-3dab30145145 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:53.045140 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-667e6736-fc32-46d8-b7f2-3dab30145145 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:53.045584 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-667e6736-fc32-46d8-b7f2-3dab30145145 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:53.186000 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-667e6736-fc32-46d8-b7f2-3dab30145145 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:53.195760 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-667e6736-fc32-46d8-b7f2-3dab30145145 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1520 microversion: 2.1 time: 0.161875 Jan 18 16:30:53.196365 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 65/135] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:53 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:30:53.509529 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-6a1da66c-18aa-417c-9efb-2852f9d0711a tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:53.510174 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-6a1da66c-18aa-417c-9efb-2852f9d0711a tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] [instance: 989d2f30-5220-48b9-99b1-743321171593] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:53.517016 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6a1da66c-18aa-417c-9efb-2852f9d0711a tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:53.517486 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6a1da66c-18aa-417c-9efb-2852f9d0711a tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:53.518348 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6a1da66c-18aa-417c-9efb-2852f9d0711a tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:53.518777 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6a1da66c-18aa-417c-9efb-2852f9d0711a tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:53.656151 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-6a1da66c-18aa-417c-9efb-2852f9d0711a tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441a94d1e434168a4563c2ed04adf12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b205cbc85b42462e9fb91e126616d33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:53.663995 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-6a1da66c-18aa-417c-9efb-2852f9d0711a tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] 10.222.0.82 "GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593" status: 200 len: 1553 microversion: 2.1 time: 0.159440 Jan 18 16:30:53.664560 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 71/136] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:53 2022] GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593 => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:30:54.014324 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-5765ee0e-e18b-4147-8e2f-bd1ac708b9bf tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:30:54.015412 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-5765ee0e-e18b-4147-8e2f-bd1ac708b9bf tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:54.021537 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-5765ee0e-e18b-4147-8e2f-bd1ac708b9bf tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:54.022072 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-5765ee0e-e18b-4147-8e2f-bd1ac708b9bf tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:54.022854 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-5765ee0e-e18b-4147-8e2f-bd1ac708b9bf tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:54.023486 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-5765ee0e-e18b-4147-8e2f-bd1ac708b9bf tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:54.211849 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-9c3de52c-0b0a-46ca-a0e4-920cd0a37ec1 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:54.212461 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-9c3de52c-0b0a-46ca-a0e4-920cd0a37ec1 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:54.218709 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-9c3de52c-0b0a-46ca-a0e4-920cd0a37ec1 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:54.219158 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-9c3de52c-0b0a-46ca-a0e4-920cd0a37ec1 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:54.219932 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-9c3de52c-0b0a-46ca-a0e4-920cd0a37ec1 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:54.220367 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-9c3de52c-0b0a-46ca-a0e4-920cd0a37ec1 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:54.353197 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-9c3de52c-0b0a-46ca-a0e4-920cd0a37ec1 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:54.360769 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-9c3de52c-0b0a-46ca-a0e4-920cd0a37ec1 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1520 microversion: 2.1 time: 0.152568 Jan 18 16:30:54.362042 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 72/137] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:54 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:30:54.680254 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-476c9f7b-f898-433e-b6ae-0d6fe49ff46f tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:54.680868 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-476c9f7b-f898-433e-b6ae-0d6fe49ff46f tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] [instance: 989d2f30-5220-48b9-99b1-743321171593] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:54.686815 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-476c9f7b-f898-433e-b6ae-0d6fe49ff46f tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:54.687262 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-476c9f7b-f898-433e-b6ae-0d6fe49ff46f tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:54.688042 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-476c9f7b-f898-433e-b6ae-0d6fe49ff46f tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:54.688479 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-476c9f7b-f898-433e-b6ae-0d6fe49ff46f tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:54.825225 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-476c9f7b-f898-433e-b6ae-0d6fe49ff46f tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441a94d1e434168a4563c2ed04adf12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b205cbc85b42462e9fb91e126616d33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:54.833470 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-476c9f7b-f898-433e-b6ae-0d6fe49ff46f tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] 10.222.0.82 "GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593" status: 200 len: 1553 microversion: 2.1 time: 0.156673 Jan 18 16:30:54.834041 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 73/138] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:54 2022] GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593 => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:30:55.378876 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-ce389ee3-c6b2-406d-8180-e0e83cd42ecd tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:55.379550 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-ce389ee3-c6b2-406d-8180-e0e83cd42ecd tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:55.385484 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-ce389ee3-c6b2-406d-8180-e0e83cd42ecd tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:55.385932 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-ce389ee3-c6b2-406d-8180-e0e83cd42ecd tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:55.386718 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-ce389ee3-c6b2-406d-8180-e0e83cd42ecd tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:55.387151 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-ce389ee3-c6b2-406d-8180-e0e83cd42ecd tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:55.518742 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-ce389ee3-c6b2-406d-8180-e0e83cd42ecd tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:55.526077 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-ce389ee3-c6b2-406d-8180-e0e83cd42ecd tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1520 microversion: 2.1 time: 0.151507 Jan 18 16:30:55.526625 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 74/139] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:55 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:30:55.850017 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-0c907b9d-2c64-48c3-91cf-f78425af24a8 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:55.850619 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-0c907b9d-2c64-48c3-91cf-f78425af24a8 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] [instance: 989d2f30-5220-48b9-99b1-743321171593] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:55.856363 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0c907b9d-2c64-48c3-91cf-f78425af24a8 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:55.856806 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0c907b9d-2c64-48c3-91cf-f78425af24a8 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:55.857603 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0c907b9d-2c64-48c3-91cf-f78425af24a8 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:55.858032 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0c907b9d-2c64-48c3-91cf-f78425af24a8 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:55.984501 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-0c907b9d-2c64-48c3-91cf-f78425af24a8 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441a94d1e434168a4563c2ed04adf12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b205cbc85b42462e9fb91e126616d33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:55.992731 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-0c907b9d-2c64-48c3-91cf-f78425af24a8 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] 10.222.0.82 "GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593" status: 200 len: 1553 microversion: 2.1 time: 0.146343 Jan 18 16:30:55.993325 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 75/140] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:55 2022] GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593 => generated 1553 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:30:56.542446 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-3e38cb73-4f2a-437d-a8a2-3c92c512b08d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:56.543094 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-3e38cb73-4f2a-437d-a8a2-3c92c512b08d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:56.550060 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-3e38cb73-4f2a-437d-a8a2-3c92c512b08d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:56.550509 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-3e38cb73-4f2a-437d-a8a2-3c92c512b08d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:56.551279 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-3e38cb73-4f2a-437d-a8a2-3c92c512b08d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:56.551709 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-3e38cb73-4f2a-437d-a8a2-3c92c512b08d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:56.658750 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-5765ee0e-e18b-4147-8e2f-bd1ac708b9bf tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action" status: 200 len: 14 microversion: 2.20 time: 2.647506 Jan 18 16:30:56.660038 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 66/141] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:30:54 2022] POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action => generated 14 bytes in 2651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:30:56.689180 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-3e38cb73-4f2a-437d-a8a2-3c92c512b08d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:56.697608 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-3e38cb73-4f2a-437d-a8a2-3c92c512b08d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1520 microversion: 2.1 time: 0.158803 Jan 18 16:30:56.698384 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 76/142] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:56 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:30:57.010489 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-e33de4d6-4c2d-496e-bf90-feb0bcd261b1 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:57.011180 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-e33de4d6-4c2d-496e-bf90-feb0bcd261b1 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] [instance: 989d2f30-5220-48b9-99b1-743321171593] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:57.018732 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e33de4d6-4c2d-496e-bf90-feb0bcd261b1 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:57.019179 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e33de4d6-4c2d-496e-bf90-feb0bcd261b1 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:57.019952 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e33de4d6-4c2d-496e-bf90-feb0bcd261b1 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:57.020379 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e33de4d6-4c2d-496e-bf90-feb0bcd261b1 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:57.374645 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-e33de4d6-4c2d-496e-bf90-feb0bcd261b1 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441a94d1e434168a4563c2ed04adf12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b205cbc85b42462e9fb91e126616d33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:57.383012 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-e33de4d6-4c2d-496e-bf90-feb0bcd261b1 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] 10.222.0.82 "GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593" status: 200 len: 1553 microversion: 2.1 time: 0.376541 Jan 18 16:30:57.383850 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 67/143] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:57 2022] GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593 => generated 1553 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:30:57.669562 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-dcfae405-b0c8-47d3-a4d2-abdfad4307c4 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:30:57.670528 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-dcfae405-b0c8-47d3-a4d2-abdfad4307c4 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:57.677057 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-dcfae405-b0c8-47d3-a4d2-abdfad4307c4 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:57.677499 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-dcfae405-b0c8-47d3-a4d2-abdfad4307c4 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:57.678281 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-dcfae405-b0c8-47d3-a4d2-abdfad4307c4 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:57.678711 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-dcfae405-b0c8-47d3-a4d2-abdfad4307c4 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:57.715752 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-11767fa6-c1ee-4193-a015-46caad76aa89 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:57.716375 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-11767fa6-c1ee-4193-a015-46caad76aa89 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:57.722847 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-11767fa6-c1ee-4193-a015-46caad76aa89 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:57.723297 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-11767fa6-c1ee-4193-a015-46caad76aa89 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:57.724120 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-11767fa6-c1ee-4193-a015-46caad76aa89 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:57.724555 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-11767fa6-c1ee-4193-a015-46caad76aa89 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:57.862673 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-11767fa6-c1ee-4193-a015-46caad76aa89 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:57.870201 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-11767fa6-c1ee-4193-a015-46caad76aa89 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1520 microversion: 2.1 time: 0.158333 Jan 18 16:30:57.870767 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 68/144] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:57 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:30:57.874961 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [req-59d2f21b-5fc2-4998-9118-7f880258aae4 req-bc8174ec-5a92-43a7-a6ff-5a55f481ef9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "989d2f30-5220-48b9-99b1-743321171593", "name": "network-vif-deleted", "tag": "ce661267-6290-428f-af8d-cd5d03d770e2"}]} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:30:57.876450 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:30:57.876450 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: warnings.warn(msg) Jan 18 16:30:57.883808 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-59d2f21b-5fc2-4998-9118-7f880258aae4 req-bc8174ec-5a92-43a7-a6ff-5a55f481ef9b service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:57.884246 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-59d2f21b-5fc2-4998-9118-7f880258aae4 req-bc8174ec-5a92-43a7-a6ff-5a55f481ef9b service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:57.895215 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.compute.server_external_events [req-59d2f21b-5fc2-4998-9118-7f880258aae4 req-bc8174ec-5a92-43a7-a6ff-5a55f481ef9b service nova] Creating event network-vif-deleted:ce661267-6290-428f-af8d-cd5d03d770e2 for instance 989d2f30-5220-48b9-99b1-743321171593 on hv-cinder-78836 Jan 18 16:30:57.899933 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [req-59d2f21b-5fc2-4998-9118-7f880258aae4 req-bc8174ec-5a92-43a7-a6ff-5a55f481ef9b service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028087 Jan 18 16:30:57.900523 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 69/145] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:30:58.402284 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-8baee6bb-197c-4db5-b1ab-4481c33fc89e tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:58.402889 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-8baee6bb-197c-4db5-b1ab-4481c33fc89e tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] [instance: 989d2f30-5220-48b9-99b1-743321171593] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:58.409577 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8baee6bb-197c-4db5-b1ab-4481c33fc89e tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:58.410017 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8baee6bb-197c-4db5-b1ab-4481c33fc89e tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:58.410802 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8baee6bb-197c-4db5-b1ab-4481c33fc89e tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:58.411233 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8baee6bb-197c-4db5-b1ab-4481c33fc89e tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:58.469167 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-8baee6bb-197c-4db5-b1ab-4481c33fc89e tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441a94d1e434168a4563c2ed04adf12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b205cbc85b42462e9fb91e126616d33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:58.477351 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-8baee6bb-197c-4db5-b1ab-4481c33fc89e tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] 10.222.0.82 "GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593" status: 200 len: 1511 microversion: 2.1 time: 0.079586 Jan 18 16:30:58.477921 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 70/146] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:58 2022] GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593 => generated 1511 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:30:58.888159 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-5a2b3760-bdab-4f0f-9b19-c264c188902b tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:58.888812 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-5a2b3760-bdab-4f0f-9b19-c264c188902b tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:58.895449 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-5a2b3760-bdab-4f0f-9b19-c264c188902b tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:58.895890 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-5a2b3760-bdab-4f0f-9b19-c264c188902b tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:58.896661 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-5a2b3760-bdab-4f0f-9b19-c264c188902b tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:58.897115 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-5a2b3760-bdab-4f0f-9b19-c264c188902b tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:59.025498 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-5a2b3760-bdab-4f0f-9b19-c264c188902b tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:59.032658 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-5a2b3760-bdab-4f0f-9b19-c264c188902b tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1520 microversion: 2.1 time: 0.148140 Jan 18 16:30:59.033882 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 71/147] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:58 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:30:59.494697 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-d97ff164-6d7f-42a0-9567-a60fafebdd68 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:30:59.495217 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-d97ff164-6d7f-42a0-9567-a60fafebdd68 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] [instance: 989d2f30-5220-48b9-99b1-743321171593] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:30:59.501477 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d97ff164-6d7f-42a0-9567-a60fafebdd68 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:59.502543 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d97ff164-6d7f-42a0-9567-a60fafebdd68 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:59.503321 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d97ff164-6d7f-42a0-9567-a60fafebdd68 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:30:59.503757 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d97ff164-6d7f-42a0-9567-a60fafebdd68 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:30:59.567036 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-d97ff164-6d7f-42a0-9567-a60fafebdd68 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441a94d1e434168a4563c2ed04adf12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b205cbc85b42462e9fb91e126616d33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:30:59.574678 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-d97ff164-6d7f-42a0-9567-a60fafebdd68 tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] 10.222.0.82 "GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593" status: 200 len: 1511 microversion: 2.1 time: 0.083715 Jan 18 16:30:59.575257 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 72/148] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:30:59 2022] GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593 => generated 1511 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:31:00.050953 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-d43040fb-6774-44da-9be5-b3b8412603a1 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:00.051635 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-d43040fb-6774-44da-9be5-b3b8412603a1 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:00.067043 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d43040fb-6774-44da-9be5-b3b8412603a1 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:00.067589 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d43040fb-6774-44da-9be5-b3b8412603a1 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:00.068457 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d43040fb-6774-44da-9be5-b3b8412603a1 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:00.069250 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d43040fb-6774-44da-9be5-b3b8412603a1 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:00.080417 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-dcfae405-b0c8-47d3-a4d2-abdfad4307c4 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action" status: 200 len: 10009 microversion: 2.20 time: 2.414115 Jan 18 16:31:00.081277 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 77/149] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:30:57 2022] POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action => generated 10009 bytes in 2416 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:31:00.325369 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-d43040fb-6774-44da-9be5-b3b8412603a1 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:31:00.335368 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-d43040fb-6774-44da-9be5-b3b8412603a1 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1520 microversion: 2.1 time: 0.289177 Jan 18 16:31:00.336052 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 73/150] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:31:00 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1520 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:31:00.592511 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-bc1e9a54-b9d3-40f8-ac78-4a1b878b230b tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:00.593134 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-bc1e9a54-b9d3-40f8-ac78-4a1b878b230b tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] [instance: 989d2f30-5220-48b9-99b1-743321171593] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:00.600527 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-bc1e9a54-b9d3-40f8-ac78-4a1b878b230b tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:00.601022 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-bc1e9a54-b9d3-40f8-ac78-4a1b878b230b tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:00.601824 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-bc1e9a54-b9d3-40f8-ac78-4a1b878b230b tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:00.602254 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-bc1e9a54-b9d3-40f8-ac78-4a1b878b230b tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:00.668394 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-bc1e9a54-b9d3-40f8-ac78-4a1b878b230b tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441a94d1e434168a4563c2ed04adf12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b205cbc85b42462e9fb91e126616d33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:31:00.676795 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-bc1e9a54-b9d3-40f8-ac78-4a1b878b230b tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] 10.222.0.82 "GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593" status: 200 len: 1346 microversion: 2.1 time: 0.088482 Jan 18 16:31:00.677454 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 78/151] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:31:00 2022] GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593 => generated 1346 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:31:01.091942 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-b5ceef8c-87ab-4646-96f1-705c9dc02f84 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:31:01.093129 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-b5ceef8c-87ab-4646-96f1-705c9dc02f84 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:01.101414 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-b5ceef8c-87ab-4646-96f1-705c9dc02f84 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:01.101820 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-b5ceef8c-87ab-4646-96f1-705c9dc02f84 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:01.103270 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-b5ceef8c-87ab-4646-96f1-705c9dc02f84 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:01.103710 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-b5ceef8c-87ab-4646-96f1-705c9dc02f84 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:01.206833 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-b5ceef8c-87ab-4646-96f1-705c9dc02f84 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action" status: 200 len: 15025 microversion: 2.20 time: 0.118347 Jan 18 16:31:01.208967 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 74/152] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:31:01 2022] POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action => generated 15025 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:31:01.352004 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-46939589-108e-4d38-a882-285866032da6 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:01.354310 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-46939589-108e-4d38-a882-285866032da6 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:01.377598 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-46939589-108e-4d38-a882-285866032da6 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:01.378326 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-46939589-108e-4d38-a882-285866032da6 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:01.379764 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-46939589-108e-4d38-a882-285866032da6 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:01.382799 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-46939589-108e-4d38-a882-285866032da6 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:01.565705 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-46939589-108e-4d38-a882-285866032da6 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:31:01.573402 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-46939589-108e-4d38-a882-285866032da6 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1520 microversion: 2.1 time: 0.224982 Jan 18 16:31:01.574065 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 79/153] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:31:01 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1520 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:31:01.694185 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-96cb4bc6-f8e8-43bb-91c5-e378497f73fa tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:01.694938 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-96cb4bc6-f8e8-43bb-91c5-e378497f73fa tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] [instance: 989d2f30-5220-48b9-99b1-743321171593] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:01.701680 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-96cb4bc6-f8e8-43bb-91c5-e378497f73fa tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:01.702127 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-96cb4bc6-f8e8-43bb-91c5-e378497f73fa tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:01.702894 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-96cb4bc6-f8e8-43bb-91c5-e378497f73fa tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:01.703426 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-96cb4bc6-f8e8-43bb-91c5-e378497f73fa tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:01.718043 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.wsgi [None req-96cb4bc6-f8e8-43bb-91c5-e378497f73fa tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] HTTP exception thrown: Instance 989d2f30-5220-48b9-99b1-743321171593 could not be found. Jan 18 16:31:01.718707 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-96cb4bc6-f8e8-43bb-91c5-e378497f73fa tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Returning 404 to user: Instance 989d2f30-5220-48b9-99b1-743321171593 could not be found. {{(pid=116368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 16:31:01.719515 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-96cb4bc6-f8e8-43bb-91c5-e378497f73fa tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] 10.222.0.82 "GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593" status: 404 len: 111 microversion: 2.1 time: 0.029757 Jan 18 16:31:01.720102 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 75/154] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:31:01 2022] GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 16:31:01.826429 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-9c73da83-ace1-454f-abc9-eb9d4a10b88b tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:01.827707 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-9c73da83-ace1-454f-abc9-eb9d4a10b88b tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] [instance: 989d2f30-5220-48b9-99b1-743321171593] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:01.834955 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-9c73da83-ace1-454f-abc9-eb9d4a10b88b tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:01.835420 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-9c73da83-ace1-454f-abc9-eb9d4a10b88b tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:01.836220 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-9c73da83-ace1-454f-abc9-eb9d4a10b88b tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:01.836655 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-9c73da83-ace1-454f-abc9-eb9d4a10b88b tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:01.851033 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.wsgi [None req-9c73da83-ace1-454f-abc9-eb9d4a10b88b tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] HTTP exception thrown: Instance 989d2f30-5220-48b9-99b1-743321171593 could not be found. Jan 18 16:31:01.851650 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-9c73da83-ace1-454f-abc9-eb9d4a10b88b tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Returning 404 to user: Instance 989d2f30-5220-48b9-99b1-743321171593 could not be found. {{(pid=116367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 16:31:01.852467 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-9c73da83-ace1-454f-abc9-eb9d4a10b88b tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] 10.222.0.82 "GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.030089 Jan 18 16:31:01.853019 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 80/155] 10.222.0.82 () {58 vars in 1301 bytes} [Tue Jan 18 16:31:01 2022] GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593/os-volume_attachments => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 16:31:02.219541 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-b7b8b240-a30f-46b9-8e17-297284ce43a6 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:31:02.220480 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-b7b8b240-a30f-46b9-8e17-297284ce43a6 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:02.227008 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-b7b8b240-a30f-46b9-8e17-297284ce43a6 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:02.227467 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-b7b8b240-a30f-46b9-8e17-297284ce43a6 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:02.228272 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-b7b8b240-a30f-46b9-8e17-297284ce43a6 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:02.228697 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-b7b8b240-a30f-46b9-8e17-297284ce43a6 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:02.305321 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-b7b8b240-a30f-46b9-8e17-297284ce43a6 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action" status: 200 len: 18208 microversion: 2.20 time: 0.089128 Jan 18 16:31:02.306011 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 76/156] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:31:02 2022] POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action => generated 18208 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:31:02.590677 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-5cddb75b-ea91-47cb-99f5-18bd9319cf74 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:02.591302 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-5cddb75b-ea91-47cb-99f5-18bd9319cf74 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:02.600933 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-5cddb75b-ea91-47cb-99f5-18bd9319cf74 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:02.601407 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-5cddb75b-ea91-47cb-99f5-18bd9319cf74 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:02.602229 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-5cddb75b-ea91-47cb-99f5-18bd9319cf74 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:02.602693 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-5cddb75b-ea91-47cb-99f5-18bd9319cf74 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:02.757597 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-5cddb75b-ea91-47cb-99f5-18bd9319cf74 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:31:02.766526 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-5cddb75b-ea91-47cb-99f5-18bd9319cf74 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1520 microversion: 2.1 time: 0.180026 Jan 18 16:31:02.767794 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 81/157] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:31:02 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:31:03.060338 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-e3ffa8e6-8894-44cc-9e49-3c5d02c40bdb tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:03.061578 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-e3ffa8e6-8894-44cc-9e49-3c5d02c40bdb tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] [instance: 989d2f30-5220-48b9-99b1-743321171593] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:03.072325 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e3ffa8e6-8894-44cc-9e49-3c5d02c40bdb tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:03.072973 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e3ffa8e6-8894-44cc-9e49-3c5d02c40bdb tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:03.073988 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e3ffa8e6-8894-44cc-9e49-3c5d02c40bdb tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:03.074655 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e3ffa8e6-8894-44cc-9e49-3c5d02c40bdb tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:03.091511 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.wsgi [None req-e3ffa8e6-8894-44cc-9e49-3c5d02c40bdb tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] HTTP exception thrown: Instance 989d2f30-5220-48b9-99b1-743321171593 could not be found. Jan 18 16:31:03.092559 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-e3ffa8e6-8894-44cc-9e49-3c5d02c40bdb tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Returning 404 to user: Instance 989d2f30-5220-48b9-99b1-743321171593 could not be found. {{(pid=116368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 16:31:03.093509 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-e3ffa8e6-8894-44cc-9e49-3c5d02c40bdb tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] 10.222.0.82 "DELETE /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593" status: 404 len: 111 microversion: 2.1 time: 0.040648 Jan 18 16:31:03.094356 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 77/158] 10.222.0.82 () {58 vars in 1238 bytes} [Tue Jan 18 16:31:03 2022] DELETE /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 16:31:03.114675 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-dcf483bb-a06e-4914-81eb-80a9b26e5e1f tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:03.114675 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-dcf483bb-a06e-4914-81eb-80a9b26e5e1f tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] [instance: 989d2f30-5220-48b9-99b1-743321171593] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:03.114675 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-dcf483bb-a06e-4914-81eb-80a9b26e5e1f tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:03.114675 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-dcf483bb-a06e-4914-81eb-80a9b26e5e1f tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:03.115234 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-dcf483bb-a06e-4914-81eb-80a9b26e5e1f tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:03.115234 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-dcf483bb-a06e-4914-81eb-80a9b26e5e1f tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:03.128808 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.wsgi [None req-dcf483bb-a06e-4914-81eb-80a9b26e5e1f tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] HTTP exception thrown: Instance 989d2f30-5220-48b9-99b1-743321171593 could not be found. Jan 18 16:31:03.129527 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-dcf483bb-a06e-4914-81eb-80a9b26e5e1f tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] Returning 404 to user: Instance 989d2f30-5220-48b9-99b1-743321171593 could not be found. {{(pid=116367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 16:31:03.130371 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-dcf483bb-a06e-4914-81eb-80a9b26e5e1f tempest-DeleteServersTestJSON-1031530213 tempest-DeleteServersTestJSON-1031530213-project] 10.222.0.82 "GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593" status: 404 len: 111 microversion: 2.1 time: 0.031013 Jan 18 16:31:03.130901 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 82/159] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:31:03 2022] GET /compute/v2.1/servers/989d2f30-5220-48b9-99b1-743321171593 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 16:31:03.317742 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-6d58e747-261b-43b6-a5b0-f791e1e27df5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:31:03.318647 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-6d58e747-261b-43b6-a5b0-f791e1e27df5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:03.324883 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-6d58e747-261b-43b6-a5b0-f791e1e27df5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:03.325347 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-6d58e747-261b-43b6-a5b0-f791e1e27df5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:03.328812 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-6d58e747-261b-43b6-a5b0-f791e1e27df5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:03.328812 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-6d58e747-261b-43b6-a5b0-f791e1e27df5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:03.789271 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-1bd7b344-523e-4044-bd56-7a8c2f633221 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:03.789875 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-1bd7b344-523e-4044-bd56-7a8c2f633221 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:03.796104 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-1bd7b344-523e-4044-bd56-7a8c2f633221 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:03.796478 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-1bd7b344-523e-4044-bd56-7a8c2f633221 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:03.797287 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-1bd7b344-523e-4044-bd56-7a8c2f633221 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:03.797716 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-1bd7b344-523e-4044-bd56-7a8c2f633221 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:03.965550 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-1bd7b344-523e-4044-bd56-7a8c2f633221 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:31:03.981441 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-1bd7b344-523e-4044-bd56-7a8c2f633221 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1520 microversion: 2.1 time: 0.199492 Jan 18 16:31:03.982027 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 83/160] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:31:03 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:31:04.999992 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-22f6bf5d-5d76-46a0-b51b-5e30a8faf769 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:05.000753 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-22f6bf5d-5d76-46a0-b51b-5e30a8faf769 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:05.007390 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-22f6bf5d-5d76-46a0-b51b-5e30a8faf769 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:05.007954 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-22f6bf5d-5d76-46a0-b51b-5e30a8faf769 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:05.008884 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-22f6bf5d-5d76-46a0-b51b-5e30a8faf769 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:05.009424 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-22f6bf5d-5d76-46a0-b51b-5e30a8faf769 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:05.159908 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-22f6bf5d-5d76-46a0-b51b-5e30a8faf769 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:31:05.167515 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-22f6bf5d-5d76-46a0-b51b-5e30a8faf769 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1520 microversion: 2.1 time: 0.172089 Jan 18 16:31:05.168071 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 84/161] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:31:04 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:31:06.183372 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-4d8a682f-cd7f-4716-8051-8268e924cc46 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:06.183981 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-4d8a682f-cd7f-4716-8051-8268e924cc46 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:06.190384 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4d8a682f-cd7f-4716-8051-8268e924cc46 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:06.191073 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4d8a682f-cd7f-4716-8051-8268e924cc46 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:06.191853 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4d8a682f-cd7f-4716-8051-8268e924cc46 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:06.192288 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4d8a682f-cd7f-4716-8051-8268e924cc46 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:06.223659 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-6d58e747-261b-43b6-a5b0-f791e1e27df5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action" status: 200 len: 22960 microversion: 2.20 time: 2.909757 Jan 18 16:31:06.224399 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 78/162] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:31:03 2022] POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action => generated 22960 bytes in 2911 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:31:06.322635 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-4d8a682f-cd7f-4716-8051-8268e924cc46 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:31:06.330852 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-4d8a682f-cd7f-4716-8051-8268e924cc46 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1520 microversion: 2.1 time: 0.150579 Jan 18 16:31:06.331407 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 85/163] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:31:06 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:31:07.224672 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-8398a037-4736-4c96-9bf2-8972cac749fe tempest-VolumesTestJSON-1135831437 tempest-VolumesTestJSON-1135831437-project] Calling method '.version_select at 0x7f33a4bd5b80>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:07.239270 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-0fe232e3-fd08-4d8c-ad30-017e75d4c4f7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:31:07.243172 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-0fe232e3-fd08-4d8c-ad30-017e75d4c4f7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:07.257207 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0fe232e3-fd08-4d8c-ad30-017e75d4c4f7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:07.258388 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0fe232e3-fd08-4d8c-ad30-017e75d4c4f7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:07.260397 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0fe232e3-fd08-4d8c-ad30-017e75d4c4f7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:07.261450 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0fe232e3-fd08-4d8c-ad30-017e75d4c4f7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:07.306610 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-8398a037-4736-4c96-9bf2-8972cac749fe tempest-VolumesTestJSON-1135831437 tempest-VolumesTestJSON-1135831437-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/82e64ec7-8879-4589-8263-1f76e598c5ef" status: 200 len: 351 microversion: 2.1 time: 0.087397 Jan 18 16:31:07.307389 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 79/164] 10.222.0.82 () {58 vars in 1244 bytes} [Tue Jan 18 16:31:07 2022] GET /compute/v2.1/os-volumes/82e64ec7-8879-4589-8263-1f76e598c5ef => generated 351 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:31:07.358208 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-086710bc-a83c-46f5-a655-c2be8a1a4fd8 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:07.359002 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-086710bc-a83c-46f5-a655-c2be8a1a4fd8 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:07.366387 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-086710bc-a83c-46f5-a655-c2be8a1a4fd8 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:07.366953 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-086710bc-a83c-46f5-a655-c2be8a1a4fd8 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:07.367800 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-086710bc-a83c-46f5-a655-c2be8a1a4fd8 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:07.368373 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-086710bc-a83c-46f5-a655-c2be8a1a4fd8 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:07.394322 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-0fe232e3-fd08-4d8c-ad30-017e75d4c4f7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action" status: 200 len: 23783 microversion: 2.20 time: 0.161917 Jan 18 16:31:07.395111 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 86/165] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:31:07 2022] POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action => generated 23783 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:31:07.528515 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-086710bc-a83c-46f5-a655-c2be8a1a4fd8 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:31:07.541717 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-086710bc-a83c-46f5-a655-c2be8a1a4fd8 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1520 microversion: 2.1 time: 0.197536 Jan 18 16:31:07.542677 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 80/166] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:31:07 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:31:08.406921 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-7c2e5d94-c514-4fca-aceb-7b8a7718b32d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:31:08.407953 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-7c2e5d94-c514-4fca-aceb-7b8a7718b32d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:08.419351 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7c2e5d94-c514-4fca-aceb-7b8a7718b32d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:08.419864 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7c2e5d94-c514-4fca-aceb-7b8a7718b32d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:08.420840 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7c2e5d94-c514-4fca-aceb-7b8a7718b32d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:08.421504 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7c2e5d94-c514-4fca-aceb-7b8a7718b32d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:08.559240 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-cde6556d-ecba-4096-ba44-7a7208eaa13d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:08.559910 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-cde6556d-ecba-4096-ba44-7a7208eaa13d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:08.567340 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-cde6556d-ecba-4096-ba44-7a7208eaa13d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:08.567982 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-cde6556d-ecba-4096-ba44-7a7208eaa13d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:08.568955 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-cde6556d-ecba-4096-ba44-7a7208eaa13d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:08.569614 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-cde6556d-ecba-4096-ba44-7a7208eaa13d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:08.775517 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-cde6556d-ecba-4096-ba44-7a7208eaa13d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:31:08.784818 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-cde6556d-ecba-4096-ba44-7a7208eaa13d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1520 microversion: 2.1 time: 0.229127 Jan 18 16:31:08.786417 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 81/167] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:31:08 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1520 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:31:08.800889 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-8ec25276-ddd2-42b0-a22e-4fff80403099 tempest-VolumesTestJSON-1135831437 tempest-VolumesTestJSON-1135831437-project] Calling method '.version_select at 0x7f33a54dd310>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:08.858122 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-8ec25276-ddd2-42b0-a22e-4fff80403099 tempest-VolumesTestJSON-1135831437 tempest-VolumesTestJSON-1135831437-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/49ecad0f-13c0-4ca2-9454-fef3e87833df" status: 200 len: 351 microversion: 2.1 time: 0.069889 Jan 18 16:31:08.858765 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 82/168] 10.222.0.82 () {58 vars in 1244 bytes} [Tue Jan 18 16:31:08 2022] GET /compute/v2.1/os-volumes/49ecad0f-13c0-4ca2-9454-fef3e87833df => generated 351 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:31:09.802497 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-18679675-b205-43dc-873d-60fd766ea72a tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:09.803120 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-18679675-b205-43dc-873d-60fd766ea72a tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:09.811038 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-18679675-b205-43dc-873d-60fd766ea72a tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:09.811523 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-18679675-b205-43dc-873d-60fd766ea72a tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:09.812353 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-18679675-b205-43dc-873d-60fd766ea72a tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:09.812788 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-18679675-b205-43dc-873d-60fd766ea72a tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:09.961566 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-18679675-b205-43dc-873d-60fd766ea72a tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:31:09.969378 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-18679675-b205-43dc-873d-60fd766ea72a tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1520 microversion: 2.1 time: 0.171873 Jan 18 16:31:09.970596 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 83/169] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:31:09 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:31:10.986937 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-135a9623-1deb-4a20-9458-27ea3d685980 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:10.987689 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-135a9623-1deb-4a20-9458-27ea3d685980 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:10.994363 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-135a9623-1deb-4a20-9458-27ea3d685980 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:10.994774 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-135a9623-1deb-4a20-9458-27ea3d685980 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:10.995560 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-135a9623-1deb-4a20-9458-27ea3d685980 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:10.995996 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-135a9623-1deb-4a20-9458-27ea3d685980 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:11.078280 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-7c2e5d94-c514-4fca-aceb-7b8a7718b32d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action" status: 200 len: 25402 microversion: 2.20 time: 2.675881 Jan 18 16:31:11.078950 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 87/170] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:31:08 2022] POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action => generated 25402 bytes in 2678 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:31:11.129619 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-135a9623-1deb-4a20-9458-27ea3d685980 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:31:11.136798 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-135a9623-1deb-4a20-9458-27ea3d685980 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1520 microversion: 2.1 time: 0.154140 Jan 18 16:31:11.137377 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 84/171] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:31:10 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:31:12.090180 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-a1197be3-f3f6-47a4-818c-c355aafa4a49 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:31:12.091968 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-a1197be3-f3f6-47a4-818c-c355aafa4a49 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:12.099631 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a1197be3-f3f6-47a4-818c-c355aafa4a49 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:12.100085 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a1197be3-f3f6-47a4-818c-c355aafa4a49 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:12.100874 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a1197be3-f3f6-47a4-818c-c355aafa4a49 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:12.101489 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a1197be3-f3f6-47a4-818c-c355aafa4a49 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:12.153548 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-4550054d-6c31-4995-8672-8f395ee7ef20 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:12.154159 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-4550054d-6c31-4995-8672-8f395ee7ef20 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:12.161579 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4550054d-6c31-4995-8672-8f395ee7ef20 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:12.161995 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4550054d-6c31-4995-8672-8f395ee7ef20 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:12.163019 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4550054d-6c31-4995-8672-8f395ee7ef20 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:12.163493 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4550054d-6c31-4995-8672-8f395ee7ef20 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:12.186730 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-a1197be3-f3f6-47a4-818c-c355aafa4a49 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action" status: 200 len: 27070 microversion: 2.20 time: 0.100240 Jan 18 16:31:12.187931 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 88/172] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:31:12 2022] POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action => generated 27070 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:31:12.310627 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-bb3a0b9a-f960-41ef-9631-452fcbf18b74 tempest-VolumesTestJSON-1135831437 tempest-VolumesTestJSON-1135831437-project] Calling method '.version_select at 0x7f33a5389160>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:12.323057 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-4550054d-6c31-4995-8672-8f395ee7ef20 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:31:12.332015 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-4550054d-6c31-4995-8672-8f395ee7ef20 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1520 microversion: 2.1 time: 0.182059 Jan 18 16:31:12.332764 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 85/173] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:31:12 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:31:12.374348 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-bb3a0b9a-f960-41ef-9631-452fcbf18b74 tempest-VolumesTestJSON-1135831437 tempest-VolumesTestJSON-1135831437-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/30f380e6-0177-45c1-adea-96bdcf9123d0" status: 200 len: 351 microversion: 2.1 time: 0.067406 Jan 18 16:31:12.374937 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 89/174] 10.222.0.82 () {58 vars in 1244 bytes} [Tue Jan 18 16:31:12 2022] GET /compute/v2.1/os-volumes/30f380e6-0177-45c1-adea-96bdcf9123d0 => generated 351 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:31:12.386354 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-036bbf7e-85f9-4d62-94ad-123b7ec286a0 tempest-VolumesTestJSON-1135831437 tempest-VolumesTestJSON-1135831437-project] Calling method '.version_select at 0x7f33a5532e50>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:12.632132 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-036bbf7e-85f9-4d62-94ad-123b7ec286a0 tempest-VolumesTestJSON-1135831437 tempest-VolumesTestJSON-1135831437-project] 10.222.0.82 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.249702 Jan 18 16:31:12.632803 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 86/175] 10.222.0.82 () {58 vars in 1133 bytes} [Tue Jan 18 16:31:12 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:31:12.647491 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-66c5910c-27d1-46c4-a8a1-8222ecb165a0 tempest-VolumesTestJSON-1135831437 tempest-VolumesTestJSON-1135831437-project] Calling method '.version_select at 0x7f33a54a6b80>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:12.743219 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-66c5910c-27d1-46c4-a8a1-8222ecb165a0 tempest-VolumesTestJSON-1135831437 tempest-VolumesTestJSON-1135831437-project] 10.222.0.82 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.101915 Jan 18 16:31:12.743804 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 90/176] 10.222.0.82 () {58 vars in 1148 bytes} [Tue Jan 18 16:31:12 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 16:31:12.755452 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-debb1f68-ca4a-4bea-bc6c-ee9ddaa7e234 tempest-VolumesTestJSON-1135831437 tempest-VolumesTestJSON-1135831437-project] Calling method '.version_select at 0x7f33a4bdbaf0>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:12.836033 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-debb1f68-ca4a-4bea-bc6c-ee9ddaa7e234 tempest-VolumesTestJSON-1135831437 tempest-VolumesTestJSON-1135831437-project] 10.222.0.82 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.084177 Jan 18 16:31:12.836803 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 87/177] 10.222.0.82 () {58 vars in 1133 bytes} [Tue Jan 18 16:31:12 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:31:12.848746 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-4dce29fe-5d46-42fb-89fa-725e744d66f6 tempest-VolumesTestJSON-1135831437 tempest-VolumesTestJSON-1135831437-project] Calling method '.version_select at 0x7f33a539baf0>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:12.928841 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-4dce29fe-5d46-42fb-89fa-725e744d66f6 tempest-VolumesTestJSON-1135831437 tempest-VolumesTestJSON-1135831437-project] 10.222.0.82 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.084635 Jan 18 16:31:12.929489 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 91/178] 10.222.0.82 () {58 vars in 1166 bytes} [Tue Jan 18 16:31:12 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:31:12.941338 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-8a6730c3-1771-4253-b462-4b13d1ca532b tempest-VolumesTestJSON-1135831437 tempest-VolumesTestJSON-1135831437-project] Calling method '.version_select at 0x7f33a4c6d790>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:13.024508 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-8a6730c3-1771-4253-b462-4b13d1ca532b tempest-VolumesTestJSON-1135831437 tempest-VolumesTestJSON-1135831437-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.087203 Jan 18 16:31:13.025103 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 88/179] 10.222.0.82 () {58 vars in 1169 bytes} [Tue Jan 18 16:31:12 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:31:13.041267 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-3d185fc2-fd2f-4a85-a485-cb1bc3575ed9 tempest-VolumesTestJSON-1135831437 tempest-VolumesTestJSON-1135831437-project] Calling method '.version_select at 0x7f33a54d2940>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:13.143731 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-3d185fc2-fd2f-4a85-a485-cb1bc3575ed9 tempest-VolumesTestJSON-1135831437 tempest-VolumesTestJSON-1135831437-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.105957 Jan 18 16:31:13.144603 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 92/180] 10.222.0.82 () {58 vars in 1154 bytes} [Tue Jan 18 16:31:13 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:31:13.155615 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-e9e9993e-8dd4-4816-8301-08cb49e1414d tempest-VolumesTestJSON-1135831437 tempest-VolumesTestJSON-1135831437-project] Calling method '.version_select at 0x7f33a4c6d0d0>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:13.199274 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-5ca194c7-f7a0-4810-94db-3834a94e4412 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:31:13.200518 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-5ca194c7-f7a0-4810-94db-3834a94e4412 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:13.208026 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-5ca194c7-f7a0-4810-94db-3834a94e4412 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:13.208674 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-5ca194c7-f7a0-4810-94db-3834a94e4412 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:13.209484 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-5ca194c7-f7a0-4810-94db-3834a94e4412 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:13.209921 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-5ca194c7-f7a0-4810-94db-3834a94e4412 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:13.239625 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-e9e9993e-8dd4-4816-8301-08cb49e1414d tempest-VolumesTestJSON-1135831437 tempest-VolumesTestJSON-1135831437-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.087592 Jan 18 16:31:13.240226 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 89/181] 10.222.0.82 () {58 vars in 1187 bytes} [Tue Jan 18 16:31:13 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:31:13.251115 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-a05c24fa-d18e-4a72-a02b-a0473b156ccd tempest-VolumesTestJSON-1135831437 tempest-VolumesTestJSON-1135831437-project] Calling method '.version_select at 0x7f33a4bd39d0>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:13.292618 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-5ca194c7-f7a0-4810-94db-3834a94e4412 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action" status: 200 len: 27485 microversion: 2.20 time: 0.097264 Jan 18 16:31:13.293942 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 93/182] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:31:13 2022] POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action => generated 27485 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 18 16:31:13.332888 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-a05c24fa-d18e-4a72-a02b-a0473b156ccd tempest-VolumesTestJSON-1135831437 tempest-VolumesTestJSON-1135831437-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.085137 Jan 18 16:31:13.333484 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 90/183] 10.222.0.82 () {58 vars in 1154 bytes} [Tue Jan 18 16:31:13 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:31:13.351171 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-7bb5163c-c744-4cfa-bf63-15b93121df21 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:13.351851 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-7bb5163c-c744-4cfa-bf63-15b93121df21 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:13.358816 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7bb5163c-c744-4cfa-bf63-15b93121df21 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:13.359256 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7bb5163c-c744-4cfa-bf63-15b93121df21 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:13.360031 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7bb5163c-c744-4cfa-bf63-15b93121df21 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:13.360460 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7bb5163c-c744-4cfa-bf63-15b93121df21 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:13.525489 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-7bb5163c-c744-4cfa-bf63-15b93121df21 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:31:13.534303 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-7bb5163c-c744-4cfa-bf63-15b93121df21 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1520 microversion: 2.1 time: 0.187061 Jan 18 16:31:13.534873 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 94/184] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:31:13 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:31:14.307402 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-3266c508-dddc-41d1-9ec1-34e6f4780407 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:31:14.309355 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-3266c508-dddc-41d1-9ec1-34e6f4780407 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:14.317124 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3266c508-dddc-41d1-9ec1-34e6f4780407 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:14.317699 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3266c508-dddc-41d1-9ec1-34e6f4780407 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:14.318643 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3266c508-dddc-41d1-9ec1-34e6f4780407 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:14.319512 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3266c508-dddc-41d1-9ec1-34e6f4780407 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:14.442024 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-3266c508-dddc-41d1-9ec1-34e6f4780407 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action" status: 200 len: 27719 microversion: 2.20 time: 0.138254 Jan 18 16:31:14.442898 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 91/185] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:31:14 2022] POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action => generated 27719 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:31:14.553306 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-05068073-ced0-40ba-bdfa-204740c1e123 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:14.553306 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-05068073-ced0-40ba-bdfa-204740c1e123 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:14.558614 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-05068073-ced0-40ba-bdfa-204740c1e123 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:14.559058 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-05068073-ced0-40ba-bdfa-204740c1e123 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:14.559842 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-05068073-ced0-40ba-bdfa-204740c1e123 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:14.560274 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-05068073-ced0-40ba-bdfa-204740c1e123 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:14.725722 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-05068073-ced0-40ba-bdfa-204740c1e123 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:31:14.733220 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-05068073-ced0-40ba-bdfa-204740c1e123 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1520 microversion: 2.1 time: 0.185661 Jan 18 16:31:14.733963 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 95/186] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:31:14 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:31:15.455754 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-17d13044-c0f6-47aa-9a78-a78f29f036f0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:31:15.456822 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-17d13044-c0f6-47aa-9a78-a78f29f036f0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:15.463955 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-17d13044-c0f6-47aa-9a78-a78f29f036f0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:15.464584 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-17d13044-c0f6-47aa-9a78-a78f29f036f0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:15.465404 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-17d13044-c0f6-47aa-9a78-a78f29f036f0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:15.465976 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-17d13044-c0f6-47aa-9a78-a78f29f036f0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:15.579444 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-17d13044-c0f6-47aa-9a78-a78f29f036f0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action" status: 200 len: 27972 microversion: 2.20 time: 0.128612 Jan 18 16:31:15.580091 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 92/187] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:31:15 2022] POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action => generated 27972 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:31:15.751998 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-235ad360-d681-49bd-9dff-e32619f20045 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:15.753040 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-235ad360-d681-49bd-9dff-e32619f20045 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:15.759896 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-235ad360-d681-49bd-9dff-e32619f20045 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:15.761499 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-235ad360-d681-49bd-9dff-e32619f20045 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:15.768558 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-235ad360-d681-49bd-9dff-e32619f20045 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:15.769366 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-235ad360-d681-49bd-9dff-e32619f20045 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:15.942078 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-235ad360-d681-49bd-9dff-e32619f20045 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:31:15.953521 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-235ad360-d681-49bd-9dff-e32619f20045 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1520 microversion: 2.1 time: 0.205327 Jan 18 16:31:15.954860 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 96/188] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:31:15 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1520 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:31:16.592722 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-353eef80-88d9-4de6-85af-49b41b412640 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:31:16.594672 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-353eef80-88d9-4de6-85af-49b41b412640 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:16.602536 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-353eef80-88d9-4de6-85af-49b41b412640 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:16.603440 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-353eef80-88d9-4de6-85af-49b41b412640 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:16.604719 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-353eef80-88d9-4de6-85af-49b41b412640 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:16.605359 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-353eef80-88d9-4de6-85af-49b41b412640 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:16.726939 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-353eef80-88d9-4de6-85af-49b41b412640 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action" status: 200 len: 28138 microversion: 2.20 time: 0.138169 Jan 18 16:31:16.728321 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 93/189] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:31:16 2022] POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action => generated 28138 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:31:16.972730 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-adc8ac2f-cf76-462d-982f-81853fcc1eb3 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:16.974114 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-adc8ac2f-cf76-462d-982f-81853fcc1eb3 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:16.988214 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-adc8ac2f-cf76-462d-982f-81853fcc1eb3 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:16.989887 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-adc8ac2f-cf76-462d-982f-81853fcc1eb3 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:16.991038 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-adc8ac2f-cf76-462d-982f-81853fcc1eb3 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:16.992815 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-adc8ac2f-cf76-462d-982f-81853fcc1eb3 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:17.173697 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-adc8ac2f-cf76-462d-982f-81853fcc1eb3 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:31:17.181240 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-adc8ac2f-cf76-462d-982f-81853fcc1eb3 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1520 microversion: 2.1 time: 0.213750 Jan 18 16:31:17.181896 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 97/190] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:31:16 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1520 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:31:17.739670 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-9368f8ec-73fd-4364-810d-53b6e4fbf505 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:31:17.741002 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-9368f8ec-73fd-4364-810d-53b6e4fbf505 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:17.748202 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-9368f8ec-73fd-4364-810d-53b6e4fbf505 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:17.748549 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-9368f8ec-73fd-4364-810d-53b6e4fbf505 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:17.749359 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-9368f8ec-73fd-4364-810d-53b6e4fbf505 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:17.749958 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-9368f8ec-73fd-4364-810d-53b6e4fbf505 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:17.833880 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-9368f8ec-73fd-4364-810d-53b6e4fbf505 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action" status: 200 len: 28138 microversion: 2.20 time: 0.098574 Jan 18 16:31:17.839730 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 94/191] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:31:17 2022] POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action => generated 28138 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:31:18.198468 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-e11eb817-2d9b-4171-ae68-748d2336f8aa tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:18.207502 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-e11eb817-2d9b-4171-ae68-748d2336f8aa tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:18.215777 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e11eb817-2d9b-4171-ae68-748d2336f8aa tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:18.216510 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e11eb817-2d9b-4171-ae68-748d2336f8aa tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:18.217503 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e11eb817-2d9b-4171-ae68-748d2336f8aa tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:18.218089 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e11eb817-2d9b-4171-ae68-748d2336f8aa tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:18.484284 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-e11eb817-2d9b-4171-ae68-748d2336f8aa tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:31:18.494003 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-e11eb817-2d9b-4171-ae68-748d2336f8aa tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1520 microversion: 2.1 time: 0.298663 Jan 18 16:31:18.495160 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 98/192] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:31:18 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1520 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:31:18.847895 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-0f05047c-0e20-417b-98d6-a41f74f1b73f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:31:18.848833 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-0f05047c-0e20-417b-98d6-a41f74f1b73f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:18.856293 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0f05047c-0e20-417b-98d6-a41f74f1b73f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:18.857034 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0f05047c-0e20-417b-98d6-a41f74f1b73f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:18.858004 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0f05047c-0e20-417b-98d6-a41f74f1b73f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:18.858602 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0f05047c-0e20-417b-98d6-a41f74f1b73f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:18.927341 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-0f05047c-0e20-417b-98d6-a41f74f1b73f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action" status: 200 len: 28138 microversion: 2.20 time: 0.084285 Jan 18 16:31:18.932475 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 95/193] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:31:18 2022] POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action => generated 28138 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:31:19.511181 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-aef3e226-d18e-436f-aa34-648c7d22e876 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:19.512992 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-aef3e226-d18e-436f-aa34-648c7d22e876 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:19.521973 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-aef3e226-d18e-436f-aa34-648c7d22e876 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:19.522755 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-aef3e226-d18e-436f-aa34-648c7d22e876 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:19.523876 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-aef3e226-d18e-436f-aa34-648c7d22e876 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:19.525523 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-aef3e226-d18e-436f-aa34-648c7d22e876 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:19.710305 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-aef3e226-d18e-436f-aa34-648c7d22e876 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:31:19.719589 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-aef3e226-d18e-436f-aa34-648c7d22e876 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1520 microversion: 2.1 time: 0.211840 Jan 18 16:31:19.720989 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 99/194] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:31:19 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1520 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:31:19.944724 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-fb374758-1487-4c9d-b083-2d9d2ccdc4be tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:31:19.947079 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-fb374758-1487-4c9d-b083-2d9d2ccdc4be tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:19.957322 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-fb374758-1487-4c9d-b083-2d9d2ccdc4be tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:19.958339 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-fb374758-1487-4c9d-b083-2d9d2ccdc4be tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:19.959231 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-fb374758-1487-4c9d-b083-2d9d2ccdc4be tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:19.960308 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-fb374758-1487-4c9d-b083-2d9d2ccdc4be tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:20.034222 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-fb374758-1487-4c9d-b083-2d9d2ccdc4be tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action" status: 200 len: 28138 microversion: 2.20 time: 0.097263 Jan 18 16:31:20.035266 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 96/195] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:31:19 2022] POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action => generated 28138 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:31:20.738646 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-433abfe9-1884-4fd9-a14b-ac7ad7987872 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:20.739680 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-433abfe9-1884-4fd9-a14b-ac7ad7987872 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:20.750663 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-433abfe9-1884-4fd9-a14b-ac7ad7987872 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:20.752161 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-433abfe9-1884-4fd9-a14b-ac7ad7987872 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:20.754898 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-433abfe9-1884-4fd9-a14b-ac7ad7987872 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:20.756178 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-433abfe9-1884-4fd9-a14b-ac7ad7987872 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:21.026024 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-433abfe9-1884-4fd9-a14b-ac7ad7987872 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:31:21.047334 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-e04d7b9a-53b6-4787-89d5-0e7510bae022 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:31:21.048973 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-e04d7b9a-53b6-4787-89d5-0e7510bae022 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:21.059101 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-433abfe9-1884-4fd9-a14b-ac7ad7987872 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1520 microversion: 2.1 time: 0.324504 Jan 18 16:31:21.060471 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 100/196] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:31:20 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1520 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:31:21.062773 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e04d7b9a-53b6-4787-89d5-0e7510bae022 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:21.063936 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e04d7b9a-53b6-4787-89d5-0e7510bae022 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:21.065445 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e04d7b9a-53b6-4787-89d5-0e7510bae022 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:21.066988 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e04d7b9a-53b6-4787-89d5-0e7510bae022 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:22.079704 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-2f016b73-431c-471f-bc4b-a154a56cdc8a tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:22.081010 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-2f016b73-431c-471f-bc4b-a154a56cdc8a tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:22.087911 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2f016b73-431c-471f-bc4b-a154a56cdc8a tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:22.088471 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2f016b73-431c-471f-bc4b-a154a56cdc8a tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:22.089646 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2f016b73-431c-471f-bc4b-a154a56cdc8a tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:22.090195 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2f016b73-431c-471f-bc4b-a154a56cdc8a tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:22.233446 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-2f016b73-431c-471f-bc4b-a154a56cdc8a tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:31:22.242542 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-2f016b73-431c-471f-bc4b-a154a56cdc8a tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1520 microversion: 2.1 time: 0.168700 Jan 18 16:31:22.243310 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 101/197] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:31:22 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:31:23.012456 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-e04d7b9a-53b6-4787-89d5-0e7510bae022 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action" status: 200 len: 28138 microversion: 2.20 time: 1.968814 Jan 18 16:31:23.013259 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 97/198] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:31:21 2022] POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action => generated 28138 bytes in 1971 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:31:23.263561 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-c758f3ff-da94-4c6c-8440-d0a6e8f2ad66 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:23.264148 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-c758f3ff-da94-4c6c-8440-d0a6e8f2ad66 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:23.270400 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c758f3ff-da94-4c6c-8440-d0a6e8f2ad66 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:23.270842 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c758f3ff-da94-4c6c-8440-d0a6e8f2ad66 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:23.271612 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c758f3ff-da94-4c6c-8440-d0a6e8f2ad66 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:23.272034 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c758f3ff-da94-4c6c-8440-d0a6e8f2ad66 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:23.417522 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-c758f3ff-da94-4c6c-8440-d0a6e8f2ad66 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:31:23.425715 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-c758f3ff-da94-4c6c-8440-d0a6e8f2ad66 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1520 microversion: 2.1 time: 0.166008 Jan 18 16:31:23.426279 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 102/199] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:31:23 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:31:24.027006 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-d1e4bc88-66b5-4c4a-8e1a-6ed9a237023e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:31:24.028163 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-d1e4bc88-66b5-4c4a-8e1a-6ed9a237023e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:24.041444 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d1e4bc88-66b5-4c4a-8e1a-6ed9a237023e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:24.041559 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d1e4bc88-66b5-4c4a-8e1a-6ed9a237023e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:24.042373 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d1e4bc88-66b5-4c4a-8e1a-6ed9a237023e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:24.042802 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d1e4bc88-66b5-4c4a-8e1a-6ed9a237023e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:24.149660 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-d1e4bc88-66b5-4c4a-8e1a-6ed9a237023e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action" status: 200 len: 28265 microversion: 2.20 time: 0.128227 Jan 18 16:31:24.150412 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 98/200] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:31:24 2022] POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action => generated 28265 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:31:24.443589 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-400fb438-8467-45c9-9db3-efff3584a6e6 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:24.444252 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-400fb438-8467-45c9-9db3-efff3584a6e6 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:24.450894 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-400fb438-8467-45c9-9db3-efff3584a6e6 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:24.451557 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-400fb438-8467-45c9-9db3-efff3584a6e6 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:24.452688 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-400fb438-8467-45c9-9db3-efff3584a6e6 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:24.453157 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-400fb438-8467-45c9-9db3-efff3584a6e6 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:24.639267 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-400fb438-8467-45c9-9db3-efff3584a6e6 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:31:24.648360 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-400fb438-8467-45c9-9db3-efff3584a6e6 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1520 microversion: 2.1 time: 0.209472 Jan 18 16:31:24.649287 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 103/201] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:31:24 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1520 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:31:25.165336 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-fc05077e-7f73-468e-8be0-c1fc8b39b6a5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:31:25.166469 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-fc05077e-7f73-468e-8be0-c1fc8b39b6a5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:25.174927 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-fc05077e-7f73-468e-8be0-c1fc8b39b6a5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:25.175375 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-fc05077e-7f73-468e-8be0-c1fc8b39b6a5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:25.176168 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-fc05077e-7f73-468e-8be0-c1fc8b39b6a5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:25.176780 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-fc05077e-7f73-468e-8be0-c1fc8b39b6a5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:25.277686 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-fc05077e-7f73-468e-8be0-c1fc8b39b6a5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action" status: 200 len: 28425 microversion: 2.20 time: 0.118066 Jan 18 16:31:25.278589 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 99/202] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:31:25 2022] POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action => generated 28425 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:31:25.666599 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-a6d127bd-7a05-4160-b141-baab66d6f689 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:25.671657 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-a6d127bd-7a05-4160-b141-baab66d6f689 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:25.679316 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a6d127bd-7a05-4160-b141-baab66d6f689 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:25.680061 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a6d127bd-7a05-4160-b141-baab66d6f689 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:25.681153 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a6d127bd-7a05-4160-b141-baab66d6f689 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:25.681718 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a6d127bd-7a05-4160-b141-baab66d6f689 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:25.863533 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-a6d127bd-7a05-4160-b141-baab66d6f689 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:31:25.872580 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-a6d127bd-7a05-4160-b141-baab66d6f689 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1520 microversion: 2.1 time: 0.210687 Jan 18 16:31:25.884429 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 104/203] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:31:25 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1520 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:31:26.290887 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-70307cde-d7b4-41f3-b862-9ba870f0a09c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:31:26.291883 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-70307cde-d7b4-41f3-b862-9ba870f0a09c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:26.304628 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-70307cde-d7b4-41f3-b862-9ba870f0a09c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:26.304628 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-70307cde-d7b4-41f3-b862-9ba870f0a09c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:26.304628 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-70307cde-d7b4-41f3-b862-9ba870f0a09c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:26.305046 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-70307cde-d7b4-41f3-b862-9ba870f0a09c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:26.892213 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-379a4d36-c3bc-44a2-839c-74a078bd0312 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:26.892782 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-379a4d36-c3bc-44a2-839c-74a078bd0312 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:26.898824 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-379a4d36-c3bc-44a2-839c-74a078bd0312 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:26.899271 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-379a4d36-c3bc-44a2-839c-74a078bd0312 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:26.900133 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-379a4d36-c3bc-44a2-839c-74a078bd0312 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:26.900567 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-379a4d36-c3bc-44a2-839c-74a078bd0312 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:27.031820 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-379a4d36-c3bc-44a2-839c-74a078bd0312 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:31:27.039323 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-379a4d36-c3bc-44a2-839c-74a078bd0312 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1520 microversion: 2.1 time: 0.151594 Jan 18 16:31:27.039888 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 105/204] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:31:26 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:31:28.055743 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-d0d85698-bbee-4125-b74e-d552446769ef tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:28.056365 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-d0d85698-bbee-4125-b74e-d552446769ef tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:28.062542 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-d0d85698-bbee-4125-b74e-d552446769ef tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:28.062977 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-d0d85698-bbee-4125-b74e-d552446769ef tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:28.064395 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-d0d85698-bbee-4125-b74e-d552446769ef tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:28.064819 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-d0d85698-bbee-4125-b74e-d552446769ef tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:28.196987 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-d0d85698-bbee-4125-b74e-d552446769ef tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:31:28.204425 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-d0d85698-bbee-4125-b74e-d552446769ef tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1520 microversion: 2.1 time: 0.152042 Jan 18 16:31:28.205018 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 106/205] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:31:28 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:31:29.085601 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-70307cde-d7b4-41f3-b862-9ba870f0a09c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action" status: 200 len: 28592 microversion: 2.20 time: 2.798463 Jan 18 16:31:29.086254 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 100/206] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:31:26 2022] POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action => generated 28592 bytes in 2800 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:31:29.221284 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-61a1ddbd-f832-4157-849c-82df11d034eb tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:29.221829 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-61a1ddbd-f832-4157-849c-82df11d034eb tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:29.228103 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-61a1ddbd-f832-4157-849c-82df11d034eb tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:29.228573 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-61a1ddbd-f832-4157-849c-82df11d034eb tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:29.229375 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-61a1ddbd-f832-4157-849c-82df11d034eb tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:29.229806 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-61a1ddbd-f832-4157-849c-82df11d034eb tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:29.364699 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-61a1ddbd-f832-4157-849c-82df11d034eb tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:31:29.372163 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-61a1ddbd-f832-4157-849c-82df11d034eb tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1520 microversion: 2.1 time: 0.154627 Jan 18 16:31:29.372751 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 107/207] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:31:29 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:31:30.098258 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-69b993a1-0fc4-4161-9f13-c945c00bf8c1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:31:30.099471 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-69b993a1-0fc4-4161-9f13-c945c00bf8c1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:30.107983 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-69b993a1-0fc4-4161-9f13-c945c00bf8c1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:30.108590 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-69b993a1-0fc4-4161-9f13-c945c00bf8c1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:30.109497 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-69b993a1-0fc4-4161-9f13-c945c00bf8c1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:30.109974 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-69b993a1-0fc4-4161-9f13-c945c00bf8c1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:30.179966 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-69b993a1-0fc4-4161-9f13-c945c00bf8c1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action" status: 200 len: 28592 microversion: 2.20 time: 0.086105 Jan 18 16:31:30.181120 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 101/208] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:31:30 2022] POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action => generated 28592 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:31:30.391691 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-78ca21b0-5d39-48d2-8bc4-b86e0b8e5cb1 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:30.392671 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-78ca21b0-5d39-48d2-8bc4-b86e0b8e5cb1 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:30.399025 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-78ca21b0-5d39-48d2-8bc4-b86e0b8e5cb1 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:30.399478 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-78ca21b0-5d39-48d2-8bc4-b86e0b8e5cb1 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:30.400260 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-78ca21b0-5d39-48d2-8bc4-b86e0b8e5cb1 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:30.400698 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-78ca21b0-5d39-48d2-8bc4-b86e0b8e5cb1 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:30.544667 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-78ca21b0-5d39-48d2-8bc4-b86e0b8e5cb1 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:31:30.554241 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-78ca21b0-5d39-48d2-8bc4-b86e0b8e5cb1 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1520 microversion: 2.1 time: 0.168073 Jan 18 16:31:30.554797 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 108/209] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:31:30 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:31:31.193604 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-725c4a34-1d74-4656-b84e-72db4d7bd6c7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:31:31.194614 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-725c4a34-1d74-4656-b84e-72db4d7bd6c7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:31.203516 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-725c4a34-1d74-4656-b84e-72db4d7bd6c7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:31.203970 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-725c4a34-1d74-4656-b84e-72db4d7bd6c7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:31.204871 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-725c4a34-1d74-4656-b84e-72db4d7bd6c7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:31.205328 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-725c4a34-1d74-4656-b84e-72db4d7bd6c7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:31.571916 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-ce221aeb-ca02-4883-b60e-5e7308692814 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:31.572521 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-ce221aeb-ca02-4883-b60e-5e7308692814 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:31.578711 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-ce221aeb-ca02-4883-b60e-5e7308692814 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:31.579148 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-ce221aeb-ca02-4883-b60e-5e7308692814 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:31.579911 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-ce221aeb-ca02-4883-b60e-5e7308692814 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:31.580335 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-ce221aeb-ca02-4883-b60e-5e7308692814 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:31.709947 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-ce221aeb-ca02-4883-b60e-5e7308692814 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:31:31.717262 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-ce221aeb-ca02-4883-b60e-5e7308692814 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1520 microversion: 2.1 time: 0.148934 Jan 18 16:31:31.717819 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 109/210] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:31:31 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:31:32.733465 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-0cc5a574-ce55-4b6e-9b90-dad4c9954153 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:32.734675 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-0cc5a574-ce55-4b6e-9b90-dad4c9954153 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:32.740911 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0cc5a574-ce55-4b6e-9b90-dad4c9954153 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:32.741391 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0cc5a574-ce55-4b6e-9b90-dad4c9954153 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:32.742172 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0cc5a574-ce55-4b6e-9b90-dad4c9954153 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:32.742606 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0cc5a574-ce55-4b6e-9b90-dad4c9954153 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:32.870251 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-0cc5a574-ce55-4b6e-9b90-dad4c9954153 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:31:32.877512 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-0cc5a574-ce55-4b6e-9b90-dad4c9954153 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1520 microversion: 2.1 time: 0.147699 Jan 18 16:31:32.878593 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 110/211] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:31:32 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:31:33.064739 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-725c4a34-1d74-4656-b84e-72db4d7bd6c7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action" status: 200 len: 28592 microversion: 2.20 time: 1.876644 Jan 18 16:31:33.066594 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 102/212] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:31:31 2022] POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action => generated 28592 bytes in 1879 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:31:33.894354 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-1a44c26c-734d-430c-a2c4-9c5c2d538d21 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:33.895126 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-1a44c26c-734d-430c-a2c4-9c5c2d538d21 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:33.901442 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-1a44c26c-734d-430c-a2c4-9c5c2d538d21 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:33.901892 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-1a44c26c-734d-430c-a2c4-9c5c2d538d21 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:33.902913 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-1a44c26c-734d-430c-a2c4-9c5c2d538d21 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:33.903701 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-1a44c26c-734d-430c-a2c4-9c5c2d538d21 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:34.070453 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-1a44c26c-734d-430c-a2c4-9c5c2d538d21 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:31:34.077855 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-36cd6299-cf62-4507-9817-d41448b8ce3c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:31:34.078382 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-1a44c26c-734d-430c-a2c4-9c5c2d538d21 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1520 microversion: 2.1 time: 0.188414 Jan 18 16:31:34.078829 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 111/213] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:31:33 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1520 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:31:34.078956 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-36cd6299-cf62-4507-9817-d41448b8ce3c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:34.088134 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-36cd6299-cf62-4507-9817-d41448b8ce3c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:34.088585 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-36cd6299-cf62-4507-9817-d41448b8ce3c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:34.089513 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-36cd6299-cf62-4507-9817-d41448b8ce3c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:34.090004 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-36cd6299-cf62-4507-9817-d41448b8ce3c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:34.155780 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-36cd6299-cf62-4507-9817-d41448b8ce3c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action" status: 200 len: 28592 microversion: 2.20 time: 0.081814 Jan 18 16:31:34.160573 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 103/214] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:31:34 2022] POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action => generated 28592 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:31:35.095214 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-27d06e51-42ce-4610-b941-a3897da96300 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:35.096009 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-27d06e51-42ce-4610-b941-a3897da96300 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:35.102372 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-27d06e51-42ce-4610-b941-a3897da96300 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:35.102824 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-27d06e51-42ce-4610-b941-a3897da96300 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:35.103609 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-27d06e51-42ce-4610-b941-a3897da96300 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:35.104075 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-27d06e51-42ce-4610-b941-a3897da96300 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:35.169944 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-18d15bda-2030-40e5-b25d-78b91d33b016 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:31:35.172349 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-18d15bda-2030-40e5-b25d-78b91d33b016 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:35.187776 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-18d15bda-2030-40e5-b25d-78b91d33b016 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:35.188206 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-18d15bda-2030-40e5-b25d-78b91d33b016 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:35.189020 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-18d15bda-2030-40e5-b25d-78b91d33b016 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:35.189450 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-18d15bda-2030-40e5-b25d-78b91d33b016 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:35.278191 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-18d15bda-2030-40e5-b25d-78b91d33b016 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action" status: 200 len: 28592 microversion: 2.20 time: 0.113581 Jan 18 16:31:35.279047 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 104/215] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:31:35 2022] POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action => generated 28592 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 18 16:31:35.285332 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-27d06e51-42ce-4610-b941-a3897da96300 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:31:35.292849 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-27d06e51-42ce-4610-b941-a3897da96300 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1520 microversion: 2.1 time: 0.201345 Jan 18 16:31:35.293691 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 112/216] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:31:35 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1520 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:31:36.291681 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-086af18f-9483-4843-8adc-b70c6f93da18 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:31:36.293035 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-086af18f-9483-4843-8adc-b70c6f93da18 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:36.301035 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-086af18f-9483-4843-8adc-b70c6f93da18 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:36.301482 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-086af18f-9483-4843-8adc-b70c6f93da18 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:36.302295 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-086af18f-9483-4843-8adc-b70c6f93da18 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:36.302721 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-086af18f-9483-4843-8adc-b70c6f93da18 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:36.311286 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-f2f73814-8a00-47eb-b8d5-42520008691b tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:36.312526 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-f2f73814-8a00-47eb-b8d5-42520008691b tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:36.327108 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-f2f73814-8a00-47eb-b8d5-42520008691b tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:36.327812 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-f2f73814-8a00-47eb-b8d5-42520008691b tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:36.328621 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-f2f73814-8a00-47eb-b8d5-42520008691b tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:36.331200 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-f2f73814-8a00-47eb-b8d5-42520008691b tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:36.432773 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-086af18f-9483-4843-8adc-b70c6f93da18 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action" status: 200 len: 28624 microversion: 2.20 time: 0.145189 Jan 18 16:31:36.433651 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 105/217] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:31:36 2022] POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action => generated 28624 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:31:36.557900 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-f2f73814-8a00-47eb-b8d5-42520008691b tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:31:36.576570 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-f2f73814-8a00-47eb-b8d5-42520008691b tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1520 microversion: 2.1 time: 0.269540 Jan 18 16:31:36.580139 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 113/218] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:31:36 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1520 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:31:37.446097 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-ae85bd6b-95d7-4a7d-9a7e-3d37f02b1e17 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:31:37.459224 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-ae85bd6b-95d7-4a7d-9a7e-3d37f02b1e17 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:37.481868 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ae85bd6b-95d7-4a7d-9a7e-3d37f02b1e17 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:37.482380 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ae85bd6b-95d7-4a7d-9a7e-3d37f02b1e17 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:37.483122 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ae85bd6b-95d7-4a7d-9a7e-3d37f02b1e17 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:37.483553 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ae85bd6b-95d7-4a7d-9a7e-3d37f02b1e17 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:37.610183 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-7aedf583-9335-43c4-914f-b04c99493b14 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:37.610796 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-7aedf583-9335-43c4-914f-b04c99493b14 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:37.618095 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7aedf583-9335-43c4-914f-b04c99493b14 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:37.618562 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7aedf583-9335-43c4-914f-b04c99493b14 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:37.620819 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7aedf583-9335-43c4-914f-b04c99493b14 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:37.621694 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7aedf583-9335-43c4-914f-b04c99493b14 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:37.802084 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-ae85bd6b-95d7-4a7d-9a7e-3d37f02b1e17 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action" status: 200 len: 29811 microversion: 2.20 time: 0.361980 Jan 18 16:31:37.803047 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 106/219] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:31:37 2022] POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action => generated 29811 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:31:37.807555 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-7aedf583-9335-43c4-914f-b04c99493b14 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:31:37.822167 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-7aedf583-9335-43c4-914f-b04c99493b14 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1520 microversion: 2.1 time: 0.210884 Jan 18 16:31:37.823211 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 114/220] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:31:37 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1520 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:31:38.819072 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-f9df3581-84ef-4c59-b670-5a8d2db1bfc9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:31:38.820995 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-f9df3581-84ef-4c59-b670-5a8d2db1bfc9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:38.831640 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f9df3581-84ef-4c59-b670-5a8d2db1bfc9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:38.832325 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f9df3581-84ef-4c59-b670-5a8d2db1bfc9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:38.833614 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f9df3581-84ef-4c59-b670-5a8d2db1bfc9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:38.834705 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f9df3581-84ef-4c59-b670-5a8d2db1bfc9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:38.839790 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-f673d670-b44a-4f4d-90dc-c35546e79c08 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:38.840387 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-f673d670-b44a-4f4d-90dc-c35546e79c08 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:38.879628 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-f673d670-b44a-4f4d-90dc-c35546e79c08 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:38.880195 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-f673d670-b44a-4f4d-90dc-c35546e79c08 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:38.884662 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-f673d670-b44a-4f4d-90dc-c35546e79c08 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:38.885468 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-f673d670-b44a-4f4d-90dc-c35546e79c08 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:38.928482 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-f9df3581-84ef-4c59-b670-5a8d2db1bfc9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action" status: 200 len: 31042 microversion: 2.20 time: 0.117507 Jan 18 16:31:38.930014 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 107/221] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:31:38 2022] POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action => generated 31042 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:31:39.288582 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-f673d670-b44a-4f4d-90dc-c35546e79c08 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:31:39.303708 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-f673d670-b44a-4f4d-90dc-c35546e79c08 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1500 microversion: 2.1 time: 0.462988 Jan 18 16:31:39.304976 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 115/222] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:31:38 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1500 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:31:39.322178 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-8b176b30-1d43-47fc-b949-8345dff63fae tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:39.323115 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-8b176b30-1d43-47fc-b949-8345dff63fae tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:39.334030 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8b176b30-1d43-47fc-b949-8345dff63fae tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:39.334769 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8b176b30-1d43-47fc-b949-8345dff63fae tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:39.335725 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8b176b30-1d43-47fc-b949-8345dff63fae tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:39.336311 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8b176b30-1d43-47fc-b949-8345dff63fae tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:39.542886 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-8b176b30-1d43-47fc-b949-8345dff63fae tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:31:39.560078 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-8b176b30-1d43-47fc-b949-8345dff63fae tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1514 microversion: 2.1 time: 0.241669 Jan 18 16:31:39.560667 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 108/223] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:31:39 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1514 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:31:39.942142 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-2171d0d8-9fa8-4a68-aa05-79df63268db4 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:31:39.944100 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-2171d0d8-9fa8-4a68-aa05-79df63268db4 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:39.952567 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2171d0d8-9fa8-4a68-aa05-79df63268db4 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:39.959989 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2171d0d8-9fa8-4a68-aa05-79df63268db4 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:39.961647 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2171d0d8-9fa8-4a68-aa05-79df63268db4 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:39.962518 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2171d0d8-9fa8-4a68-aa05-79df63268db4 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:40.093462 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-2171d0d8-9fa8-4a68-aa05-79df63268db4 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action" status: 200 len: 32432 microversion: 2.20 time: 0.157114 Jan 18 16:31:40.098725 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 116/224] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:31:39 2022] POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action => generated 32432 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:31:41.118638 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-5785ef27-c0e5-4127-8fcb-581e03488861 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:31:41.120470 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-5785ef27-c0e5-4127-8fcb-581e03488861 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:41.139508 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-5785ef27-c0e5-4127-8fcb-581e03488861 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:41.141308 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-5785ef27-c0e5-4127-8fcb-581e03488861 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:41.143866 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-5785ef27-c0e5-4127-8fcb-581e03488861 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:41.145745 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-5785ef27-c0e5-4127-8fcb-581e03488861 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:41.249537 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-5785ef27-c0e5-4127-8fcb-581e03488861 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action" status: 200 len: 33619 microversion: 2.20 time: 0.142260 Jan 18 16:31:41.254887 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 109/225] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:31:41 2022] POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action => generated 33619 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:31:41.267760 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-75aac873-842d-4d5a-a12b-ac9f1b52fb88 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:31:41.269616 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-75aac873-842d-4d5a-a12b-ac9f1b52fb88 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:41.286766 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-75aac873-842d-4d5a-a12b-ac9f1b52fb88 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:41.287241 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-75aac873-842d-4d5a-a12b-ac9f1b52fb88 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:41.288076 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-75aac873-842d-4d5a-a12b-ac9f1b52fb88 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:41.288507 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-75aac873-842d-4d5a-a12b-ac9f1b52fb88 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:41.344304 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.objects.instance [None req-75aac873-842d-4d5a-a12b-ac9f1b52fb88 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lazy-loading 'flavor' on Instance uuid c862639d-6995-43e1-9c7a-3d4f416629fc {{(pid=116367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 18 16:31:41.459390 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-75aac873-842d-4d5a-a12b-ac9f1b52fb88 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "POST /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc/action" status: 200 len: 32 microversion: 2.1 time: 0.196415 Jan 18 16:31:41.460564 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 117/226] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:31:41 2022] POST /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc/action => generated 32 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 18 16:31:41.474654 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-610a433a-81e9-4daa-b1bc-b2fa5e017da4 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:41.475353 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-610a433a-81e9-4daa-b1bc-b2fa5e017da4 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:41.483114 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-610a433a-81e9-4daa-b1bc-b2fa5e017da4 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:41.483613 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-610a433a-81e9-4daa-b1bc-b2fa5e017da4 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:41.484630 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-610a433a-81e9-4daa-b1bc-b2fa5e017da4 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:41.485428 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-610a433a-81e9-4daa-b1bc-b2fa5e017da4 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:42.053601 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-610a433a-81e9-4daa-b1bc-b2fa5e017da4 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:31:42.068424 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-610a433a-81e9-4daa-b1bc-b2fa5e017da4 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1520 microversion: 2.1 time: 0.594911 Jan 18 16:31:42.075128 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 110/227] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:31:41 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1520 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:31:42.271121 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-9491e2f0-a59d-4086-a942-6ac9f53238fd tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:31:42.273675 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-9491e2f0-a59d-4086-a942-6ac9f53238fd tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:42.287896 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-9491e2f0-a59d-4086-a942-6ac9f53238fd tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:42.288579 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-9491e2f0-a59d-4086-a942-6ac9f53238fd tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:42.289967 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-9491e2f0-a59d-4086-a942-6ac9f53238fd tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:42.290556 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-9491e2f0-a59d-4086-a942-6ac9f53238fd tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:42.385793 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-9491e2f0-a59d-4086-a942-6ac9f53238fd tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action" status: 200 len: 34540 microversion: 2.20 time: 0.123075 Jan 18 16:31:42.386888 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 118/228] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:31:42 2022] POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action => generated 34540 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:31:43.094409 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-ea723c17-08fe-4b98-9e50-12289542cdc9 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:43.098285 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-ea723c17-08fe-4b98-9e50-12289542cdc9 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:43.104973 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ea723c17-08fe-4b98-9e50-12289542cdc9 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:43.105726 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ea723c17-08fe-4b98-9e50-12289542cdc9 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:43.106735 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ea723c17-08fe-4b98-9e50-12289542cdc9 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:43.107376 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ea723c17-08fe-4b98-9e50-12289542cdc9 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:43.406998 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-7876571e-1001-48a5-b8ba-993af7a5ff42 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:31:43.408364 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-7876571e-1001-48a5-b8ba-993af7a5ff42 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:43.434819 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7876571e-1001-48a5-b8ba-993af7a5ff42 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:43.435482 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7876571e-1001-48a5-b8ba-993af7a5ff42 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:43.436648 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7876571e-1001-48a5-b8ba-993af7a5ff42 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:43.437344 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7876571e-1001-48a5-b8ba-993af7a5ff42 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:43.536275 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-7876571e-1001-48a5-b8ba-993af7a5ff42 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action" status: 200 len: 35349 microversion: 2.20 time: 0.134742 Jan 18 16:31:43.537649 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 119/229] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:31:43 2022] POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action => generated 35349 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:31:43.692745 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-ea723c17-08fe-4b98-9e50-12289542cdc9 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:31:43.702871 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-ea723c17-08fe-4b98-9e50-12289542cdc9 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1520 microversion: 2.1 time: 0.613713 Jan 18 16:31:43.705100 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 111/230] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:31:43 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1520 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:31:44.548493 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-788d78d6-79cf-4805-bde9-603dd5ebc44e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:31:44.550618 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-788d78d6-79cf-4805-bde9-603dd5ebc44e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:44.559852 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-788d78d6-79cf-4805-bde9-603dd5ebc44e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:44.568747 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-788d78d6-79cf-4805-bde9-603dd5ebc44e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:44.570339 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-788d78d6-79cf-4805-bde9-603dd5ebc44e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:44.574189 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-788d78d6-79cf-4805-bde9-603dd5ebc44e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:44.690441 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-788d78d6-79cf-4805-bde9-603dd5ebc44e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action" status: 200 len: 36510 microversion: 2.20 time: 0.145989 Jan 18 16:31:44.691802 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 120/231] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:31:44 2022] POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action => generated 36510 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:31:44.726282 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-141bfa7e-5d48-4ad8-960a-0ca7419a7329 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:44.726955 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-141bfa7e-5d48-4ad8-960a-0ca7419a7329 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:44.746796 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-141bfa7e-5d48-4ad8-960a-0ca7419a7329 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:44.747588 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-141bfa7e-5d48-4ad8-960a-0ca7419a7329 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:44.749805 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-141bfa7e-5d48-4ad8-960a-0ca7419a7329 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:44.751514 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-141bfa7e-5d48-4ad8-960a-0ca7419a7329 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:45.059188 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-141bfa7e-5d48-4ad8-960a-0ca7419a7329 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:31:45.074897 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-141bfa7e-5d48-4ad8-960a-0ca7419a7329 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1520 microversion: 2.1 time: 0.350263 Jan 18 16:31:45.075851 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 112/232] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:31:44 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1520 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:31:45.703801 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-d72c89be-c268-40fa-a737-d43d1dd1c3b7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:31:45.705169 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-d72c89be-c268-40fa-a737-d43d1dd1c3b7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:45.713973 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-d72c89be-c268-40fa-a737-d43d1dd1c3b7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:45.714419 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-d72c89be-c268-40fa-a737-d43d1dd1c3b7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:45.715645 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-d72c89be-c268-40fa-a737-d43d1dd1c3b7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:45.716540 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-d72c89be-c268-40fa-a737-d43d1dd1c3b7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:45.819179 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-d72c89be-c268-40fa-a737-d43d1dd1c3b7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action" status: 200 len: 37732 microversion: 2.20 time: 0.118352 Jan 18 16:31:45.827818 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 121/233] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:31:45 2022] POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action => generated 37732 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:31:46.102600 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-e1f0f67f-1ed3-494f-89b2-86410fa321ad tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:46.111584 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-e1f0f67f-1ed3-494f-89b2-86410fa321ad tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:46.125699 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e1f0f67f-1ed3-494f-89b2-86410fa321ad tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:46.126234 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e1f0f67f-1ed3-494f-89b2-86410fa321ad tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:46.127084 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e1f0f67f-1ed3-494f-89b2-86410fa321ad tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:46.128271 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e1f0f67f-1ed3-494f-89b2-86410fa321ad tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:46.337638 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-e1f0f67f-1ed3-494f-89b2-86410fa321ad tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:31:46.345861 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-e1f0f67f-1ed3-494f-89b2-86410fa321ad tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1520 microversion: 2.1 time: 0.255641 Jan 18 16:31:46.359592 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 113/234] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:31:46 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1520 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:31:46.835293 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-499e0d1b-55af-40e3-b02b-0c18a36ca61c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:31:46.840148 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-499e0d1b-55af-40e3-b02b-0c18a36ca61c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:46.847334 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-499e0d1b-55af-40e3-b02b-0c18a36ca61c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:46.853190 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-499e0d1b-55af-40e3-b02b-0c18a36ca61c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:46.854335 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-499e0d1b-55af-40e3-b02b-0c18a36ca61c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:46.857909 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-499e0d1b-55af-40e3-b02b-0c18a36ca61c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:47.365251 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-f005adda-caf8-42bc-8927-6bcd5fd68977 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:47.367025 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-f005adda-caf8-42bc-8927-6bcd5fd68977 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:47.375381 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f005adda-caf8-42bc-8927-6bcd5fd68977 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:47.376314 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f005adda-caf8-42bc-8927-6bcd5fd68977 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:47.377774 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f005adda-caf8-42bc-8927-6bcd5fd68977 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:47.378428 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f005adda-caf8-42bc-8927-6bcd5fd68977 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:47.676874 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-f005adda-caf8-42bc-8927-6bcd5fd68977 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:31:47.686593 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-f005adda-caf8-42bc-8927-6bcd5fd68977 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1520 microversion: 2.1 time: 0.327248 Jan 18 16:31:47.701154 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 114/235] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:31:47 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1520 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:31:48.703593 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-c542f782-28e8-4b7c-8818-baa5b140048e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:48.705844 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-c542f782-28e8-4b7c-8818-baa5b140048e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:48.713564 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c542f782-28e8-4b7c-8818-baa5b140048e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:48.714511 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c542f782-28e8-4b7c-8818-baa5b140048e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:48.715650 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c542f782-28e8-4b7c-8818-baa5b140048e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:48.716464 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c542f782-28e8-4b7c-8818-baa5b140048e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:48.958135 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-499e0d1b-55af-40e3-b02b-0c18a36ca61c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action" status: 200 len: 38139 microversion: 2.20 time: 2.128320 Jan 18 16:31:48.963368 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 122/236] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:31:46 2022] POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action => generated 38139 bytes in 2134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:31:48.983494 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-c542f782-28e8-4b7c-8818-baa5b140048e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:31:48.994231 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-c542f782-28e8-4b7c-8818-baa5b140048e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1520 microversion: 2.1 time: 0.294276 Jan 18 16:31:48.995478 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 115/237] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:31:48 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1520 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:31:49.975055 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-7772afcd-c08f-400a-a84d-da682dd7202e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:31:49.982533 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-7772afcd-c08f-400a-a84d-da682dd7202e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:50.010773 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7772afcd-c08f-400a-a84d-da682dd7202e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:50.011775 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-3cb3f4d8-ef45-4157-a923-8148c2429850 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:50.012378 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-3cb3f4d8-ef45-4157-a923-8148c2429850 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:50.016298 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7772afcd-c08f-400a-a84d-da682dd7202e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:50.017597 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7772afcd-c08f-400a-a84d-da682dd7202e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:50.019189 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7772afcd-c08f-400a-a84d-da682dd7202e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:50.025791 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3cb3f4d8-ef45-4157-a923-8148c2429850 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:50.026245 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3cb3f4d8-ef45-4157-a923-8148c2429850 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:50.027047 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3cb3f4d8-ef45-4157-a923-8148c2429850 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:50.027475 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3cb3f4d8-ef45-4157-a923-8148c2429850 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:50.147951 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-7772afcd-c08f-400a-a84d-da682dd7202e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action" status: 200 len: 38150 microversion: 2.20 time: 0.180372 Jan 18 16:31:50.149775 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 123/238] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:31:49 2022] POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action => generated 38150 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:31:50.439069 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-3cb3f4d8-ef45-4157-a923-8148c2429850 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:31:50.450063 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-3cb3f4d8-ef45-4157-a923-8148c2429850 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1520 microversion: 2.1 time: 0.442273 Jan 18 16:31:50.451348 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 116/239] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:31:50 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1520 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:31:51.160289 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-4f93dad1-0334-46e9-8784-383ac55406c7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:31:51.161339 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-4f93dad1-0334-46e9-8784-383ac55406c7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:51.179009 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4f93dad1-0334-46e9-8784-383ac55406c7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:51.179009 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4f93dad1-0334-46e9-8784-383ac55406c7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:51.181550 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4f93dad1-0334-46e9-8784-383ac55406c7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:51.182164 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4f93dad1-0334-46e9-8784-383ac55406c7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:51.469973 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-1cbd12c2-496a-4352-848c-a0e3c89b68b9 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:51.471483 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-1cbd12c2-496a-4352-848c-a0e3c89b68b9 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:51.487752 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1cbd12c2-496a-4352-848c-a0e3c89b68b9 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:51.490590 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1cbd12c2-496a-4352-848c-a0e3c89b68b9 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:51.493604 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1cbd12c2-496a-4352-848c-a0e3c89b68b9 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:51.494529 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1cbd12c2-496a-4352-848c-a0e3c89b68b9 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:52.043550 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-1cbd12c2-496a-4352-848c-a0e3c89b68b9 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:31:52.054688 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-1cbd12c2-496a-4352-848c-a0e3c89b68b9 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1520 microversion: 2.1 time: 0.589959 Jan 18 16:31:52.059139 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 117/240] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:31:51 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1520 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:31:53.079494 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-935801be-06f1-4350-afe6-264176524c6d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:53.081433 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-935801be-06f1-4350-afe6-264176524c6d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:53.095090 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-935801be-06f1-4350-afe6-264176524c6d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:53.095875 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-935801be-06f1-4350-afe6-264176524c6d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:53.099108 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-935801be-06f1-4350-afe6-264176524c6d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:53.099730 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-935801be-06f1-4350-afe6-264176524c6d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:53.412881 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-935801be-06f1-4350-afe6-264176524c6d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:31:53.421795 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-935801be-06f1-4350-afe6-264176524c6d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1520 microversion: 2.1 time: 0.346167 Jan 18 16:31:53.425002 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 118/241] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:31:53 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1520 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:31:53.573529 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-4f93dad1-0334-46e9-8784-383ac55406c7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action" status: 200 len: 38282 microversion: 2.20 time: 2.417265 Jan 18 16:31:53.578986 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 124/242] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:31:51 2022] POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action => generated 38282 bytes in 2419 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:31:53.585425 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-90e6c0ab-5dfe-45e6-ba40-3221d7cfacad tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:53.586283 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-90e6c0ab-5dfe-45e6-ba40-3221d7cfacad tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:53.593150 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-90e6c0ab-5dfe-45e6-ba40-3221d7cfacad tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:53.593766 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-90e6c0ab-5dfe-45e6-ba40-3221d7cfacad tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:53.594823 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-90e6c0ab-5dfe-45e6-ba40-3221d7cfacad tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:53.595421 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-90e6c0ab-5dfe-45e6-ba40-3221d7cfacad tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:53.623950 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-90e6c0ab-5dfe-45e6-ba40-3221d7cfacad tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/ips" status: 200 len: 152 microversion: 2.20 time: 0.042694 Jan 18 16:31:53.624867 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 125/243] 10.222.0.82 () {60 vars in 1288 bytes} [Tue Jan 18 16:31:53 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/ips => generated 152 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:31:53.855385 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-dd897b8f-da13-4f33-88de-e907d544d210 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Action: 'create', calling method: .version_select at 0x7f33a4bdb700>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-528604224"}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:31:53.874889 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.quota [None req-dd897b8f-da13-4f33-88de-e907d544d210 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Getting quotas for project 89b9ac86cb4c4f109b49c6f9a66379a4. Resources: {'key_pairs'} {{(pid=116368) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 16:31:53.881696 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.quota [None req-dd897b8f-da13-4f33-88de-e907d544d210 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Getting quotas for user 345686887fc3424fa518114e23f7fcc6 and project 89b9ac86cb4c4f109b49c6f9a66379a4. Resources: {'key_pairs'} {{(pid=116368) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 16:31:54.256371 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.quota [None req-dd897b8f-da13-4f33-88de-e907d544d210 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Getting quotas for project 89b9ac86cb4c4f109b49c6f9a66379a4. Resources: {'key_pairs'} {{(pid=116368) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 16:31:54.275307 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.quota [None req-dd897b8f-da13-4f33-88de-e907d544d210 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Getting quotas for user 345686887fc3424fa518114e23f7fcc6 and project 89b9ac86cb4c4f109b49c6f9a66379a4. Resources: {'key_pairs'} {{(pid=116368) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 16:31:54.315274 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-dd897b8f-da13-4f33-88de-e907d544d210 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.824803 Jan 18 16:31:54.319807 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 119/244] 10.222.0.82 () {60 vars in 1157 bytes} [Tue Jan 18 16:31:53 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:31:54.442488 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-5916c7f3-fe34-4dd3-bb49-3bc7dfd622e9 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:54.444252 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-5916c7f3-fe34-4dd3-bb49-3bc7dfd622e9 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:54.454638 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-5916c7f3-fe34-4dd3-bb49-3bc7dfd622e9 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:54.456091 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-5916c7f3-fe34-4dd3-bb49-3bc7dfd622e9 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:54.457276 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-5916c7f3-fe34-4dd3-bb49-3bc7dfd622e9 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:54.457848 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-5916c7f3-fe34-4dd3-bb49-3bc7dfd622e9 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:55.044896 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-5916c7f3-fe34-4dd3-bb49-3bc7dfd622e9 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:31:55.057894 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-5916c7f3-fe34-4dd3-bb49-3bc7dfd622e9 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1520 microversion: 2.1 time: 0.620271 Jan 18 16:31:55.058789 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 126/245] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:31:54 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1520 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:31:56.077726 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-4cee4d02-6101-4610-b8bd-08ee0246cdab tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:56.078879 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-4cee4d02-6101-4610-b8bd-08ee0246cdab tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:56.087425 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4cee4d02-6101-4610-b8bd-08ee0246cdab tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:56.088389 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4cee4d02-6101-4610-b8bd-08ee0246cdab tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:56.089700 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4cee4d02-6101-4610-b8bd-08ee0246cdab tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:56.090866 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4cee4d02-6101-4610-b8bd-08ee0246cdab tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:56.323562 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-4cee4d02-6101-4610-b8bd-08ee0246cdab tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:31:56.332087 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-4cee4d02-6101-4610-b8bd-08ee0246cdab tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1520 microversion: 2.1 time: 0.259925 Jan 18 16:31:56.343557 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 120/246] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:31:56 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1520 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:31:57.358122 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-fcd2f668-f034-49db-ba5e-12ca1874875a tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:57.358852 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-fcd2f668-f034-49db-ba5e-12ca1874875a tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:57.366156 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-fcd2f668-f034-49db-ba5e-12ca1874875a tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:57.366715 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-fcd2f668-f034-49db-ba5e-12ca1874875a tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:57.368180 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-fcd2f668-f034-49db-ba5e-12ca1874875a tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:57.368180 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-fcd2f668-f034-49db-ba5e-12ca1874875a tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:57.523981 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-fcd2f668-f034-49db-ba5e-12ca1874875a tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:31:57.532348 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-fcd2f668-f034-49db-ba5e-12ca1874875a tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1520 microversion: 2.1 time: 0.178210 Jan 18 16:31:57.533001 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 127/247] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:31:57 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:31:58.059052 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-16f275ff-d3ff-470e-a4a9-29d7cbbf48c7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:31:58.059592 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-16f275ff-d3ff-470e-a4a9-29d7cbbf48c7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:58.072682 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-16f275ff-d3ff-470e-a4a9-29d7cbbf48c7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:58.073399 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-16f275ff-d3ff-470e-a4a9-29d7cbbf48c7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:58.075179 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-16f275ff-d3ff-470e-a4a9-29d7cbbf48c7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:58.077977 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-16f275ff-d3ff-470e-a4a9-29d7cbbf48c7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:58.133593 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.objects.instance [None req-16f275ff-d3ff-470e-a4a9-29d7cbbf48c7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lazy-loading 'flavor' on Instance uuid 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee {{(pid=116368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 18 16:31:58.554590 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-caa45ae4-4165-430b-a4b4-ff205ebb0938 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:58.555406 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-caa45ae4-4165-430b-a4b4-ff205ebb0938 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:58.561979 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-caa45ae4-4165-430b-a4b4-ff205ebb0938 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:58.562427 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-caa45ae4-4165-430b-a4b4-ff205ebb0938 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:58.563347 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-caa45ae4-4165-430b-a4b4-ff205ebb0938 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:58.563787 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-caa45ae4-4165-430b-a4b4-ff205ebb0938 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:58.606075 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-16f275ff-d3ff-470e-a4a9-29d7cbbf48c7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action" status: 202 len: 0 microversion: 2.20 time: 0.551646 Jan 18 16:31:58.608594 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 121/248] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:31:58 2022] POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action => generated 0 bytes in 555 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 18 16:31:58.625263 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-3876d380-7459-45ec-9391-4a56a5c6e3fc tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:31:58.628623 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-3876d380-7459-45ec-9391-4a56a5c6e3fc tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:31:58.647621 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3876d380-7459-45ec-9391-4a56a5c6e3fc tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:58.669351 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3876d380-7459-45ec-9391-4a56a5c6e3fc tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:58.670428 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3876d380-7459-45ec-9391-4a56a5c6e3fc tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:31:58.671012 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3876d380-7459-45ec-9391-4a56a5c6e3fc tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:31:59.090253 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-3876d380-7459-45ec-9391-4a56a5c6e3fc tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:31:59.100312 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-3876d380-7459-45ec-9391-4a56a5c6e3fc tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:31:59.103039 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-caa45ae4-4165-430b-a4b4-ff205ebb0938 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:31:59.104287 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-3876d380-7459-45ec-9391-4a56a5c6e3fc tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:31:59.105507 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-3876d380-7459-45ec-9391-4a56a5c6e3fc tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1724 microversion: 2.20 time: 0.492310 Jan 18 16:31:59.106077 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 122/249] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:31:58 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1724 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:31:59.114321 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-caa45ae4-4165-430b-a4b4-ff205ebb0938 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1520 microversion: 2.1 time: 0.564795 Jan 18 16:31:59.115164 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 128/250] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:31:58 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1520 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:00.126482 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-39f3794b-a284-4900-bf61-2a46c9413c12 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:00.128144 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-39f3794b-a284-4900-bf61-2a46c9413c12 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:00.131627 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-187e47e1-6e8c-4b43-98db-cd74b4b9395d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:00.132771 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-187e47e1-6e8c-4b43-98db-cd74b4b9395d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:00.134640 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-39f3794b-a284-4900-bf61-2a46c9413c12 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:00.135095 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-39f3794b-a284-4900-bf61-2a46c9413c12 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:00.135877 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-39f3794b-a284-4900-bf61-2a46c9413c12 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:00.136310 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-39f3794b-a284-4900-bf61-2a46c9413c12 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:00.138892 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-187e47e1-6e8c-4b43-98db-cd74b4b9395d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:00.139347 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-187e47e1-6e8c-4b43-98db-cd74b4b9395d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:00.140139 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-187e47e1-6e8c-4b43-98db-cd74b4b9395d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:00.140574 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-187e47e1-6e8c-4b43-98db-cd74b4b9395d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:00.343007 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-39f3794b-a284-4900-bf61-2a46c9413c12 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:00.349874 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-187e47e1-6e8c-4b43-98db-cd74b4b9395d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:00.355113 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-39f3794b-a284-4900-bf61-2a46c9413c12 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:00.356602 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-39f3794b-a284-4900-bf61-2a46c9413c12 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:00.357085 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-187e47e1-6e8c-4b43-98db-cd74b4b9395d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1520 microversion: 2.1 time: 0.229109 Jan 18 16:32:00.357958 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 129/251] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:00 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1520 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:32:00.358069 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-39f3794b-a284-4900-bf61-2a46c9413c12 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1724 microversion: 2.20 time: 0.235204 Jan 18 16:32:00.358709 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 123/252] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:32:00 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1724 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:32:01.375546 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-783ac50c-41c6-4efa-9348-0fda336700a9 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:01.376805 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-4505296a-ff04-469c-9684-ad4d01005391 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:01.377430 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-4505296a-ff04-469c-9684-ad4d01005391 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:01.378043 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-783ac50c-41c6-4efa-9348-0fda336700a9 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:01.384071 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4505296a-ff04-469c-9684-ad4d01005391 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:01.384572 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-783ac50c-41c6-4efa-9348-0fda336700a9 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:01.384721 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4505296a-ff04-469c-9684-ad4d01005391 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:01.385460 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-783ac50c-41c6-4efa-9348-0fda336700a9 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:01.385572 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4505296a-ff04-469c-9684-ad4d01005391 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:01.385971 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4505296a-ff04-469c-9684-ad4d01005391 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:01.386940 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-783ac50c-41c6-4efa-9348-0fda336700a9 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:01.387647 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-783ac50c-41c6-4efa-9348-0fda336700a9 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:01.593390 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-4505296a-ff04-469c-9684-ad4d01005391 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:01.601435 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-783ac50c-41c6-4efa-9348-0fda336700a9 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:01.603732 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-4505296a-ff04-469c-9684-ad4d01005391 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:01.605263 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-4505296a-ff04-469c-9684-ad4d01005391 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:01.606429 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-4505296a-ff04-469c-9684-ad4d01005391 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1724 microversion: 2.20 time: 0.233257 Jan 18 16:32:01.606999 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 124/253] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:32:01 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1724 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:32:01.608600 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-783ac50c-41c6-4efa-9348-0fda336700a9 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1520 microversion: 2.1 time: 0.237957 Jan 18 16:32:01.609478 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 130/254] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:01 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1520 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:02.625750 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-9c21f7f8-6b0c-4480-ac7f-43b66a78cc3a tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:02.626293 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-7c261d0b-7a13-4f3c-8236-c66d415144f1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:02.626702 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-9c21f7f8-6b0c-4480-ac7f-43b66a78cc3a tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:02.627191 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-7c261d0b-7a13-4f3c-8236-c66d415144f1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:02.634525 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-9c21f7f8-6b0c-4480-ac7f-43b66a78cc3a tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:02.634708 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7c261d0b-7a13-4f3c-8236-c66d415144f1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:02.634973 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7c261d0b-7a13-4f3c-8236-c66d415144f1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:02.635104 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-9c21f7f8-6b0c-4480-ac7f-43b66a78cc3a tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:02.635759 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7c261d0b-7a13-4f3c-8236-c66d415144f1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:02.635866 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-9c21f7f8-6b0c-4480-ac7f-43b66a78cc3a tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:02.636191 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7c261d0b-7a13-4f3c-8236-c66d415144f1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:02.636282 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-9c21f7f8-6b0c-4480-ac7f-43b66a78cc3a tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:02.880369 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-7c261d0b-7a13-4f3c-8236-c66d415144f1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:02.887572 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-9c21f7f8-6b0c-4480-ac7f-43b66a78cc3a tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:02.888644 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-7c261d0b-7a13-4f3c-8236-c66d415144f1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:02.890168 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-7c261d0b-7a13-4f3c-8236-c66d415144f1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:02.891328 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-7c261d0b-7a13-4f3c-8236-c66d415144f1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1724 microversion: 2.20 time: 0.269125 Jan 18 16:32:02.891884 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 131/255] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:32:02 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1724 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:32:02.896492 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-9c21f7f8-6b0c-4480-ac7f-43b66a78cc3a tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1520 microversion: 2.1 time: 0.274555 Jan 18 16:32:02.897093 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 125/256] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:02 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1520 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:03.912426 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-7a48bf35-f118-4096-9db4-24cb1413ccf9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:03.913062 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-7a48bf35-f118-4096-9db4-24cb1413ccf9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:03.913665 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-f3562270-ec15-4e2d-96b2-cb3b8a8107b0 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:03.914391 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-f3562270-ec15-4e2d-96b2-cb3b8a8107b0 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:03.919526 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7a48bf35-f118-4096-9db4-24cb1413ccf9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:03.919965 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7a48bf35-f118-4096-9db4-24cb1413ccf9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:03.920454 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f3562270-ec15-4e2d-96b2-cb3b8a8107b0 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:03.920730 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7a48bf35-f118-4096-9db4-24cb1413ccf9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:03.920898 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f3562270-ec15-4e2d-96b2-cb3b8a8107b0 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:03.921199 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7a48bf35-f118-4096-9db4-24cb1413ccf9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:03.921712 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f3562270-ec15-4e2d-96b2-cb3b8a8107b0 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:03.922212 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f3562270-ec15-4e2d-96b2-cb3b8a8107b0 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:04.130509 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-7a48bf35-f118-4096-9db4-24cb1413ccf9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:04.133852 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-f3562270-ec15-4e2d-96b2-cb3b8a8107b0 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:04.138470 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-7a48bf35-f118-4096-9db4-24cb1413ccf9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:04.140032 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-7a48bf35-f118-4096-9db4-24cb1413ccf9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:04.141147 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-f3562270-ec15-4e2d-96b2-cb3b8a8107b0 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1520 microversion: 2.1 time: 0.230986 Jan 18 16:32:04.141380 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-7a48bf35-f118-4096-9db4-24cb1413ccf9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1724 microversion: 2.20 time: 0.233288 Jan 18 16:32:04.141711 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 126/257] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:03 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1520 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:04.142083 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 132/258] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:32:03 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1724 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:32:05.159886 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-775cc0a4-2a5a-4fd4-b0bd-51d08f1f80bc tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:05.160431 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-775cc0a4-2a5a-4fd4-b0bd-51d08f1f80bc tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:05.161186 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-e8840310-55b0-4c72-8402-22f2d8f69a38 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:05.161784 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-e8840310-55b0-4c72-8402-22f2d8f69a38 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:05.166635 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-775cc0a4-2a5a-4fd4-b0bd-51d08f1f80bc tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:05.167081 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-775cc0a4-2a5a-4fd4-b0bd-51d08f1f80bc tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:05.167839 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e8840310-55b0-4c72-8402-22f2d8f69a38 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:05.167958 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-775cc0a4-2a5a-4fd4-b0bd-51d08f1f80bc tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:05.168276 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-775cc0a4-2a5a-4fd4-b0bd-51d08f1f80bc tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:05.168371 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e8840310-55b0-4c72-8402-22f2d8f69a38 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:05.169089 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e8840310-55b0-4c72-8402-22f2d8f69a38 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:05.169514 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e8840310-55b0-4c72-8402-22f2d8f69a38 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:05.364984 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-775cc0a4-2a5a-4fd4-b0bd-51d08f1f80bc tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:05.368332 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-e8840310-55b0-4c72-8402-22f2d8f69a38 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:05.373010 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-775cc0a4-2a5a-4fd4-b0bd-51d08f1f80bc tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1520 microversion: 2.1 time: 0.217811 Jan 18 16:32:05.373893 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 127/259] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:05 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1520 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:32:05.389138 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-e8840310-55b0-4c72-8402-22f2d8f69a38 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:05.389138 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-e8840310-55b0-4c72-8402-22f2d8f69a38 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:05.389138 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-e8840310-55b0-4c72-8402-22f2d8f69a38 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1724 microversion: 2.20 time: 0.231425 Jan 18 16:32:05.389412 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 133/260] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:32:05 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1724 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:32:06.390458 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-ee184305-b27e-4259-87d3-a95a0b36d1b5 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:06.391114 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-ee184305-b27e-4259-87d3-a95a0b36d1b5 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:06.398117 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ee184305-b27e-4259-87d3-a95a0b36d1b5 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:06.398593 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ee184305-b27e-4259-87d3-a95a0b36d1b5 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:06.399393 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ee184305-b27e-4259-87d3-a95a0b36d1b5 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:06.399809 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ee184305-b27e-4259-87d3-a95a0b36d1b5 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:06.407101 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-53ab913e-6172-4136-a9bc-7fef5bdde9d5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:06.408718 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-53ab913e-6172-4136-a9bc-7fef5bdde9d5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:06.415865 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-53ab913e-6172-4136-a9bc-7fef5bdde9d5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:06.416310 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-53ab913e-6172-4136-a9bc-7fef5bdde9d5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:06.417628 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-53ab913e-6172-4136-a9bc-7fef5bdde9d5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:06.418407 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-53ab913e-6172-4136-a9bc-7fef5bdde9d5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:06.611178 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-ee184305-b27e-4259-87d3-a95a0b36d1b5 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:06.622604 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-ee184305-b27e-4259-87d3-a95a0b36d1b5 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1520 microversion: 2.1 time: 0.236045 Jan 18 16:32:06.626549 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-53ab913e-6172-4136-a9bc-7fef5bdde9d5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:06.629712 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 128/261] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:06 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1520 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:06.639423 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-53ab913e-6172-4136-a9bc-7fef5bdde9d5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:06.641533 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-53ab913e-6172-4136-a9bc-7fef5bdde9d5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:06.643278 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-53ab913e-6172-4136-a9bc-7fef5bdde9d5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1724 microversion: 2.20 time: 0.240093 Jan 18 16:32:06.644462 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 134/262] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:32:06 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1724 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 16:32:07.647941 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-06d95a0d-5fcb-43dc-aaa1-5ca6df513ab4 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:07.648806 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-06d95a0d-5fcb-43dc-aaa1-5ca6df513ab4 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:07.654958 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-06d95a0d-5fcb-43dc-aaa1-5ca6df513ab4 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:07.656795 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-06d95a0d-5fcb-43dc-aaa1-5ca6df513ab4 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:07.656795 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-06d95a0d-5fcb-43dc-aaa1-5ca6df513ab4 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:07.656795 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-06d95a0d-5fcb-43dc-aaa1-5ca6df513ab4 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:07.662995 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-ed7724c6-0fb7-415c-bd8c-5c47e09aa667 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:07.664319 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-ed7724c6-0fb7-415c-bd8c-5c47e09aa667 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:07.671152 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-ed7724c6-0fb7-415c-bd8c-5c47e09aa667 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:07.671888 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-ed7724c6-0fb7-415c-bd8c-5c47e09aa667 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:07.673135 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-ed7724c6-0fb7-415c-bd8c-5c47e09aa667 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:07.673794 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-ed7724c6-0fb7-415c-bd8c-5c47e09aa667 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:07.906937 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-06d95a0d-5fcb-43dc-aaa1-5ca6df513ab4 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:07.924192 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-06d95a0d-5fcb-43dc-aaa1-5ca6df513ab4 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1500 microversion: 2.1 time: 0.279889 Jan 18 16:32:07.925780 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-ed7724c6-0fb7-415c-bd8c-5c47e09aa667 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:07.926881 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 129/263] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:07 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1500 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:07.936872 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-ed7724c6-0fb7-415c-bd8c-5c47e09aa667 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:07.938743 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-ed7724c6-0fb7-415c-bd8c-5c47e09aa667 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:07.940212 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-ed7724c6-0fb7-415c-bd8c-5c47e09aa667 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1724 microversion: 2.20 time: 0.281743 Jan 18 16:32:07.952060 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-a854851b-29bd-4c76-8036-e415ffff4dfc tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "932fceae-9a7f-4446-9774-3ecf355f25a2"}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:32:07.952060 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-a854851b-29bd-4c76-8036-e415ffff4dfc tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:07.952817 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 135/264] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:32:07 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1724 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:32:07.958381 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a854851b-29bd-4c76-8036-e415ffff4dfc tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:07.958844 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a854851b-29bd-4c76-8036-e415ffff4dfc tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:07.962700 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a854851b-29bd-4c76-8036-e415ffff4dfc tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:07.964031 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a854851b-29bd-4c76-8036-e415ffff4dfc tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:07.995047 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.wsgi [None req-a854851b-29bd-4c76-8036-e415ffff4dfc tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] HTTP exception thrown: Cannot 'attach_volume' instance c862639d-6995-43e1-9c7a-3d4f416629fc while it is in vm_state rescued Jan 18 16:32:07.995719 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-a854851b-29bd-4c76-8036-e415ffff4dfc tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Returning 409 to user: Cannot 'attach_volume' instance c862639d-6995-43e1-9c7a-3d4f416629fc while it is in vm_state rescued {{(pid=116368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 16:32:07.996609 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-a854851b-29bd-4c76-8036-e415ffff4dfc tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "POST /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.056556 Jan 18 16:32:07.997254 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 130/265] 10.222.0.82 () {60 vars in 1322 bytes} [Tue Jan 18 16:32:07 2022] POST /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc/os-volume_attachments => generated 152 bytes in 58 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jan 18 16:32:08.006578 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-dac5e253-e674-495a-8a02-809a962065a7 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:32:08.007142 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-dac5e253-e674-495a-8a02-809a962065a7 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:08.012971 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-dac5e253-e674-495a-8a02-809a962065a7 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:08.013433 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-dac5e253-e674-495a-8a02-809a962065a7 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:08.014444 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-dac5e253-e674-495a-8a02-809a962065a7 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:08.015296 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-dac5e253-e674-495a-8a02-809a962065a7 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:08.110538 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-dac5e253-e674-495a-8a02-809a962065a7 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "POST /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc/action" status: 202 len: 0 microversion: 2.1 time: 0.107295 Jan 18 16:32:08.112186 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 136/266] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:32:08 2022] POST /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 18 16:32:08.121665 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-4f3808dd-9301-4c34-b319-6c21382f3a4f tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:08.123059 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-4f3808dd-9301-4c34-b319-6c21382f3a4f tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:08.130944 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4f3808dd-9301-4c34-b319-6c21382f3a4f tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:08.131425 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4f3808dd-9301-4c34-b319-6c21382f3a4f tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:08.132218 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4f3808dd-9301-4c34-b319-6c21382f3a4f tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:08.132686 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4f3808dd-9301-4c34-b319-6c21382f3a4f tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:08.511657 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-4f3808dd-9301-4c34-b319-6c21382f3a4f tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:08.520397 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-4f3808dd-9301-4c34-b319-6c21382f3a4f tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1508 microversion: 2.1 time: 0.403419 Jan 18 16:32:08.521056 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 131/267] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:08 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1508 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:08.961034 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-ef508b3d-ffbf-4d60-a572-259aadeef3eb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:08.962072 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-ef508b3d-ffbf-4d60-a572-259aadeef3eb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:08.969564 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-ef508b3d-ffbf-4d60-a572-259aadeef3eb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:08.970060 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-ef508b3d-ffbf-4d60-a572-259aadeef3eb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:08.970911 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-ef508b3d-ffbf-4d60-a572-259aadeef3eb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:08.971368 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-ef508b3d-ffbf-4d60-a572-259aadeef3eb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:09.170517 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-ef508b3d-ffbf-4d60-a572-259aadeef3eb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:09.180604 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-ef508b3d-ffbf-4d60-a572-259aadeef3eb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:09.182335 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-ef508b3d-ffbf-4d60-a572-259aadeef3eb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:09.183555 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-ef508b3d-ffbf-4d60-a572-259aadeef3eb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1724 microversion: 2.20 time: 0.228152 Jan 18 16:32:09.184947 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 137/268] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:32:08 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1724 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:32:09.538694 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-d7b27308-b2b8-4ab4-b9df-a6c9ee2254db tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:09.543347 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-d7b27308-b2b8-4ab4-b9df-a6c9ee2254db tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:09.554888 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d7b27308-b2b8-4ab4-b9df-a6c9ee2254db tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:09.555534 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d7b27308-b2b8-4ab4-b9df-a6c9ee2254db tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:09.556506 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d7b27308-b2b8-4ab4-b9df-a6c9ee2254db tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:09.558395 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d7b27308-b2b8-4ab4-b9df-a6c9ee2254db tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:09.725516 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-d7b27308-b2b8-4ab4-b9df-a6c9ee2254db tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:09.733379 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-d7b27308-b2b8-4ab4-b9df-a6c9ee2254db tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1508 microversion: 2.1 time: 0.198887 Jan 18 16:32:09.734122 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 132/269] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:09 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1508 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:10.203910 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-f80db4d3-004d-44e3-ac2c-2a25b42eac2c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:10.205187 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-f80db4d3-004d-44e3-ac2c-2a25b42eac2c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:10.212759 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-f80db4d3-004d-44e3-ac2c-2a25b42eac2c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:10.213444 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-f80db4d3-004d-44e3-ac2c-2a25b42eac2c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:10.214633 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-f80db4d3-004d-44e3-ac2c-2a25b42eac2c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:10.215263 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-f80db4d3-004d-44e3-ac2c-2a25b42eac2c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:10.458184 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-f80db4d3-004d-44e3-ac2c-2a25b42eac2c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:10.480048 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-f80db4d3-004d-44e3-ac2c-2a25b42eac2c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:10.482021 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-f80db4d3-004d-44e3-ac2c-2a25b42eac2c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:10.483359 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-f80db4d3-004d-44e3-ac2c-2a25b42eac2c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1724 microversion: 2.20 time: 0.284700 Jan 18 16:32:10.484077 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 138/270] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:32:10 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1724 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:32:10.750662 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-71358204-0868-47a4-9612-ae535b82c366 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:10.751837 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-71358204-0868-47a4-9612-ae535b82c366 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:10.759873 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-71358204-0868-47a4-9612-ae535b82c366 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:10.760578 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-71358204-0868-47a4-9612-ae535b82c366 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:10.761593 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-71358204-0868-47a4-9612-ae535b82c366 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:10.762246 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-71358204-0868-47a4-9612-ae535b82c366 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:10.937796 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-71358204-0868-47a4-9612-ae535b82c366 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:10.946698 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-71358204-0868-47a4-9612-ae535b82c366 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1508 microversion: 2.1 time: 0.199579 Jan 18 16:32:10.947479 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 133/271] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:10 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1508 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:11.511373 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-0960cd7c-2529-4bff-8ed9-c31091b992a6 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:11.511978 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-0960cd7c-2529-4bff-8ed9-c31091b992a6 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:11.520496 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0960cd7c-2529-4bff-8ed9-c31091b992a6 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:11.520960 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0960cd7c-2529-4bff-8ed9-c31091b992a6 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:11.521763 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0960cd7c-2529-4bff-8ed9-c31091b992a6 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:11.522195 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0960cd7c-2529-4bff-8ed9-c31091b992a6 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:11.687904 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-0960cd7c-2529-4bff-8ed9-c31091b992a6 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:11.700875 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-0960cd7c-2529-4bff-8ed9-c31091b992a6 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:11.704219 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-0960cd7c-2529-4bff-8ed9-c31091b992a6 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:11.705547 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-0960cd7c-2529-4bff-8ed9-c31091b992a6 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1724 microversion: 2.20 time: 0.197899 Jan 18 16:32:11.706274 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 139/272] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:32:11 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 16:32:11.972479 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-6517d8ea-a08d-474d-8457-88f9ba050d93 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:11.973915 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-6517d8ea-a08d-474d-8457-88f9ba050d93 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:11.988546 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-6517d8ea-a08d-474d-8457-88f9ba050d93 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:11.989355 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-6517d8ea-a08d-474d-8457-88f9ba050d93 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:11.990614 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-6517d8ea-a08d-474d-8457-88f9ba050d93 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:11.991320 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-6517d8ea-a08d-474d-8457-88f9ba050d93 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:12.173248 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-6517d8ea-a08d-474d-8457-88f9ba050d93 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:12.181089 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-6517d8ea-a08d-474d-8457-88f9ba050d93 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1508 microversion: 2.1 time: 0.212338 Jan 18 16:32:12.181646 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 134/273] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:11 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1508 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:12.725325 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-804ce07a-314c-4865-8e61-d1811205841a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:12.725955 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-804ce07a-314c-4865-8e61-d1811205841a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:12.732911 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-804ce07a-314c-4865-8e61-d1811205841a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:12.733498 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-804ce07a-314c-4865-8e61-d1811205841a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:12.734461 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-804ce07a-314c-4865-8e61-d1811205841a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:12.734912 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-804ce07a-314c-4865-8e61-d1811205841a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:12.927121 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-804ce07a-314c-4865-8e61-d1811205841a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:12.935550 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-804ce07a-314c-4865-8e61-d1811205841a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:12.937061 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-804ce07a-314c-4865-8e61-d1811205841a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:12.938283 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-804ce07a-314c-4865-8e61-d1811205841a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1724 microversion: 2.20 time: 0.217494 Jan 18 16:32:12.938847 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 140/274] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:32:12 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:32:13.199713 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-f3cb4542-7112-4b4b-8cee-40b82d7fc499 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:13.200751 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-f3cb4542-7112-4b4b-8cee-40b82d7fc499 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:13.209020 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f3cb4542-7112-4b4b-8cee-40b82d7fc499 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:13.209518 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f3cb4542-7112-4b4b-8cee-40b82d7fc499 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:13.210619 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f3cb4542-7112-4b4b-8cee-40b82d7fc499 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:13.211074 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f3cb4542-7112-4b4b-8cee-40b82d7fc499 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:13.383507 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-f3cb4542-7112-4b4b-8cee-40b82d7fc499 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:13.391105 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-f3cb4542-7112-4b4b-8cee-40b82d7fc499 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1508 microversion: 2.1 time: 0.195742 Jan 18 16:32:13.401726 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 135/275] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:13 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1508 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:13.976392 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-1af4f6ef-2db1-4ad0-8ce3-ecaa7b4a9cae tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:13.977126 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-1af4f6ef-2db1-4ad0-8ce3-ecaa7b4a9cae tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:13.984331 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-1af4f6ef-2db1-4ad0-8ce3-ecaa7b4a9cae tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:13.985229 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-1af4f6ef-2db1-4ad0-8ce3-ecaa7b4a9cae tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:13.986212 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-1af4f6ef-2db1-4ad0-8ce3-ecaa7b4a9cae tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:13.987549 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-1af4f6ef-2db1-4ad0-8ce3-ecaa7b4a9cae tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:14.181830 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-1af4f6ef-2db1-4ad0-8ce3-ecaa7b4a9cae tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:14.192055 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-1af4f6ef-2db1-4ad0-8ce3-ecaa7b4a9cae tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:14.193617 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-1af4f6ef-2db1-4ad0-8ce3-ecaa7b4a9cae tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:14.194742 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-1af4f6ef-2db1-4ad0-8ce3-ecaa7b4a9cae tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1724 microversion: 2.20 time: 0.241760 Jan 18 16:32:14.206825 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 141/276] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:32:13 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1724 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:32:14.410109 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-a6c7045f-c900-429c-981a-c8fd2e8cd780 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:14.410717 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-a6c7045f-c900-429c-981a-c8fd2e8cd780 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:14.417321 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a6c7045f-c900-429c-981a-c8fd2e8cd780 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:14.417846 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a6c7045f-c900-429c-981a-c8fd2e8cd780 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:14.419144 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a6c7045f-c900-429c-981a-c8fd2e8cd780 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:14.419590 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a6c7045f-c900-429c-981a-c8fd2e8cd780 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:14.603730 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-a6c7045f-c900-429c-981a-c8fd2e8cd780 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:14.614286 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-a6c7045f-c900-429c-981a-c8fd2e8cd780 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1514 microversion: 2.1 time: 0.209412 Jan 18 16:32:14.615464 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 136/277] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:14 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1514 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:15.212522 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-7cde788f-af5b-4f95-a9d2-e7a2fbd796e0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:15.214185 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-7cde788f-af5b-4f95-a9d2-e7a2fbd796e0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:15.220692 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7cde788f-af5b-4f95-a9d2-e7a2fbd796e0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:15.221157 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7cde788f-af5b-4f95-a9d2-e7a2fbd796e0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:15.221984 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7cde788f-af5b-4f95-a9d2-e7a2fbd796e0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:15.222410 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7cde788f-af5b-4f95-a9d2-e7a2fbd796e0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:15.225278 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-1ecf4a11-8b07-4507-bc91-840e97db7dba tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2106823644", "imageRef": "900c4a9d-b6c6-451f-a509-eb4f4b49f459", "flavorRef": "452", "networks": [{"uuid": "4a674afc-ab26-4529-b716-118a44373ef3"}]}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:32:15.370939 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-7cde788f-af5b-4f95-a9d2-e7a2fbd796e0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:15.378915 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-7cde788f-af5b-4f95-a9d2-e7a2fbd796e0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:15.381618 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-7cde788f-af5b-4f95-a9d2-e7a2fbd796e0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:15.383029 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-7cde788f-af5b-4f95-a9d2-e7a2fbd796e0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1724 microversion: 2.20 time: 0.174195 Jan 18 16:32:15.383753 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 142/278] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:32:15 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:32:16.062555 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-461449cf-50dc-4c5a-bb11-ecff5380df61 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:16.063469 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-461449cf-50dc-4c5a-bb11-ecff5380df61 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:16.070495 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-461449cf-50dc-4c5a-bb11-ecff5380df61 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:16.071143 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-461449cf-50dc-4c5a-bb11-ecff5380df61 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:16.081709 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-461449cf-50dc-4c5a-bb11-ecff5380df61 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:16.082425 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-461449cf-50dc-4c5a-bb11-ecff5380df61 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:16.281225 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-461449cf-50dc-4c5a-bb11-ecff5380df61 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:16.289800 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-461449cf-50dc-4c5a-bb11-ecff5380df61 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1514 microversion: 2.1 time: 0.232221 Jan 18 16:32:16.290384 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 143/279] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:16 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1514 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:32:16.305480 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-29989e47-ee8b-46d3-b2b6-8bf38c797406 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c92ed41f-79cd-4a52-83a8-2f69ce176d7a"}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:32:16.306764 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-29989e47-ee8b-46d3-b2b6-8bf38c797406 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:16.317302 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-29989e47-ee8b-46d3-b2b6-8bf38c797406 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:16.317751 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-29989e47-ee8b-46d3-b2b6-8bf38c797406 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:16.318647 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-29989e47-ee8b-46d3-b2b6-8bf38c797406 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:16.319157 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-29989e47-ee8b-46d3-b2b6-8bf38c797406 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:16.602658 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.network.neutron [None req-1ecf4a11-8b07-4507-bc91-840e97db7dba tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] validate_networks() for [('4a674afc-ab26-4529-b716-118a44373ef3', None, None, None, None, None)] {{(pid=116368) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 18 16:32:16.660515 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-29989e47-ee8b-46d3-b2b6-8bf38c797406 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "POST /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.353552 Jan 18 16:32:16.668018 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 144/280] 10.222.0.82 () {60 vars in 1322 bytes} [Tue Jan 18 16:32:16 2022] POST /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc/os-volume_attachments => generated 194 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 16:32:16.682053 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-642c5881-d259-4b7d-9a15-fd39e6c1df6f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:16.687534 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-642c5881-d259-4b7d-9a15-fd39e6c1df6f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:16.705487 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-642c5881-d259-4b7d-9a15-fd39e6c1df6f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:16.706546 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-642c5881-d259-4b7d-9a15-fd39e6c1df6f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:16.709529 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-642c5881-d259-4b7d-9a15-fd39e6c1df6f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:16.709981 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-642c5881-d259-4b7d-9a15-fd39e6c1df6f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:17.055475 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-642c5881-d259-4b7d-9a15-fd39e6c1df6f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:17.059677 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-642c5881-d259-4b7d-9a15-fd39e6c1df6f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:17.061210 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-642c5881-d259-4b7d-9a15-fd39e6c1df6f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:17.062450 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-642c5881-d259-4b7d-9a15-fd39e6c1df6f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1724 microversion: 2.20 time: 0.391564 Jan 18 16:32:17.073619 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 145/281] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:32:16 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1724 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:32:17.184451 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-1ecf4a11-8b07-4507-bc91-840e97db7dba tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Flavor limits 0:0:0 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 18 16:32:17.185007 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-1ecf4a11-8b07-4507-bc91-840e97db7dba tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Image limits 0:0:0 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 18 16:32:17.185445 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-1ecf4a11-8b07-4507-bc91-840e97db7dba tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Flavor pref 0:0:0 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 18 16:32:17.185848 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-1ecf4a11-8b07-4507-bc91-840e97db7dba tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Image pref 0:0:0 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 18 16:32:17.186248 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-1ecf4a11-8b07-4507-bc91-840e97db7dba tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 18 16:32:17.198727 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1ecf4a11-8b07-4507-bc91-840e97db7dba tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:17.202872 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1ecf4a11-8b07-4507-bc91-840e97db7dba tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:17.203744 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1ecf4a11-8b07-4507-bc91-840e97db7dba tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:17.204181 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1ecf4a11-8b07-4507-bc91-840e97db7dba tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:17.224391 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.quota [None req-1ecf4a11-8b07-4507-bc91-840e97db7dba tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Getting quotas for project ad74e7f75a7c41be9e4e3f6884b4d832. Resources: {'ram', 'instances', 'cores'} {{(pid=116368) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 16:32:17.228393 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.quota [None req-1ecf4a11-8b07-4507-bc91-840e97db7dba tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Getting quotas for user 9424067ecef94af9ae0828b77926f675 and project ad74e7f75a7c41be9e4e3f6884b4d832. Resources: {'ram', 'instances', 'cores'} {{(pid=116368) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 16:32:17.242834 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-1ecf4a11-8b07-4507-bc91-840e97db7dba tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Going to run 1 instances... {{(pid=116368) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 18 16:32:17.245167 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-1ecf4a11-8b07-4507-bc91-840e97db7dba tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c1375a98-670c-4cd0-ac9a-3f006da5670c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='900c4a9d-b6c6-451f-a509-eb4f4b49f459',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116368) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 18 16:32:17.301220 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-1ecf4a11-8b07-4507-bc91-840e97db7dba tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.081244 Jan 18 16:32:17.302181 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 137/282] 10.222.0.82 () {60 vars in 1146 bytes} [Tue Jan 18 16:32:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2084 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 18 16:32:17.312770 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-11b95914-d8de-45ba-8124-f65e91c5dfd2 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:17.314014 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-11b95914-d8de-45ba-8124-f65e91c5dfd2 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c1375a98-670c-4cd0-ac9a-3f006da5670c] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:17.653303 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-11b95914-d8de-45ba-8124-f65e91c5dfd2 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9424067ecef94af9ae0828b77926f675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74e7f75a7c41be9e4e3f6884b4d832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:17.662335 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-11b95914-d8de-45ba-8124-f65e91c5dfd2 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "GET /compute/v2.1/servers/c1375a98-670c-4cd0-ac9a-3f006da5670c" status: 200 len: 1214 microversion: 2.1 time: 0.352838 Jan 18 16:32:17.662962 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 146/283] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:17 2022] GET /compute/v2.1/servers/c1375a98-670c-4cd0-ac9a-3f006da5670c => generated 1214 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:18.081551 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-80e3846e-aedc-42d3-a949-f7cad975cc3d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:18.083000 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-80e3846e-aedc-42d3-a949-f7cad975cc3d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:18.091179 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-80e3846e-aedc-42d3-a949-f7cad975cc3d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:18.091912 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-80e3846e-aedc-42d3-a949-f7cad975cc3d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:18.092852 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-80e3846e-aedc-42d3-a949-f7cad975cc3d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:18.094138 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-80e3846e-aedc-42d3-a949-f7cad975cc3d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:18.281119 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-80e3846e-aedc-42d3-a949-f7cad975cc3d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:18.291315 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-80e3846e-aedc-42d3-a949-f7cad975cc3d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:18.293033 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-80e3846e-aedc-42d3-a949-f7cad975cc3d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:18.294951 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-80e3846e-aedc-42d3-a949-f7cad975cc3d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1724 microversion: 2.20 time: 0.217526 Jan 18 16:32:18.295858 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 138/284] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:32:18 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:32:18.682541 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-b9067df9-77fa-4849-9ffa-0302b66a273f tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:18.683268 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-b9067df9-77fa-4849-9ffa-0302b66a273f tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c1375a98-670c-4cd0-ac9a-3f006da5670c] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:18.693228 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-b9067df9-77fa-4849-9ffa-0302b66a273f tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:18.694049 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-b9067df9-77fa-4849-9ffa-0302b66a273f tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:18.697023 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-b9067df9-77fa-4849-9ffa-0302b66a273f tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:18.697857 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-b9067df9-77fa-4849-9ffa-0302b66a273f tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:18.817400 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-b9067df9-77fa-4849-9ffa-0302b66a273f tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9424067ecef94af9ae0828b77926f675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74e7f75a7c41be9e4e3f6884b4d832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:18.825396 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-b9067df9-77fa-4849-9ffa-0302b66a273f tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "GET /compute/v2.1/servers/c1375a98-670c-4cd0-ac9a-3f006da5670c" status: 200 len: 1284 microversion: 2.1 time: 0.148523 Jan 18 16:32:18.826011 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 147/285] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:18 2022] GET /compute/v2.1/servers/c1375a98-670c-4cd0-ac9a-3f006da5670c => generated 1284 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:19.278683 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-58597420-b5ca-40a9-9a8b-b644f3e3f84e tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1419207241", "imageRef": "900c4a9d-b6c6-451f-a509-eb4f4b49f459", "flavorRef": "452"}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:32:19.314085 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-034eb451-ca01-40cc-b485-65d551481bac tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:19.314991 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-034eb451-ca01-40cc-b485-65d551481bac tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:19.321258 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-034eb451-ca01-40cc-b485-65d551481bac tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:19.321899 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-034eb451-ca01-40cc-b485-65d551481bac tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:19.322875 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-034eb451-ca01-40cc-b485-65d551481bac tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:19.323453 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-034eb451-ca01-40cc-b485-65d551481bac tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:19.351805 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.network.neutron [None req-58597420-b5ca-40a9-9a8b-b644f3e3f84e tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] validate_networks() for None {{(pid=116368) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 18 16:32:19.743674 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-034eb451-ca01-40cc-b485-65d551481bac tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:19.752774 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-034eb451-ca01-40cc-b485-65d551481bac tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:19.754385 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-034eb451-ca01-40cc-b485-65d551481bac tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:19.755705 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-034eb451-ca01-40cc-b485-65d551481bac tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1745 microversion: 2.20 time: 0.445526 Jan 18 16:32:19.756255 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 148/286] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:32:19 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1745 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 16:32:19.825726 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-58597420-b5ca-40a9-9a8b-b644f3e3f84e tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Flavor limits 0:0:0 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 18 16:32:19.826112 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-58597420-b5ca-40a9-9a8b-b644f3e3f84e tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Image limits 0:0:0 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 18 16:32:19.826733 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-58597420-b5ca-40a9-9a8b-b644f3e3f84e tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Flavor pref 0:0:0 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 18 16:32:19.827142 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-58597420-b5ca-40a9-9a8b-b644f3e3f84e tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Image pref 0:0:0 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 18 16:32:19.827679 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-58597420-b5ca-40a9-9a8b-b644f3e3f84e tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 18 16:32:19.849672 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-17b66d45-23c1-4bb8-aec5-3f0ea4bded8f tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:19.850427 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-17b66d45-23c1-4bb8-aec5-3f0ea4bded8f tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c1375a98-670c-4cd0-ac9a-3f006da5670c] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:19.858067 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-58597420-b5ca-40a9-9a8b-b644f3e3f84e tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:19.858729 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-17b66d45-23c1-4bb8-aec5-3f0ea4bded8f tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:19.858897 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-58597420-b5ca-40a9-9a8b-b644f3e3f84e tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:19.859635 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-58597420-b5ca-40a9-9a8b-b644f3e3f84e tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:19.860097 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-17b66d45-23c1-4bb8-aec5-3f0ea4bded8f tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:19.860228 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-58597420-b5ca-40a9-9a8b-b644f3e3f84e tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:19.862603 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-17b66d45-23c1-4bb8-aec5-3f0ea4bded8f tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:19.863675 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-17b66d45-23c1-4bb8-aec5-3f0ea4bded8f tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:19.878880 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.quota [None req-58597420-b5ca-40a9-9a8b-b644f3e3f84e tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Getting quotas for project e92e3a1c029543f582b45037d145dd04. Resources: {'ram', 'instances', 'cores'} {{(pid=116368) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 16:32:19.884609 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.quota [None req-58597420-b5ca-40a9-9a8b-b644f3e3f84e tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Getting quotas for user 7b9b05b022da41bf84f2cdedc94af2a9 and project e92e3a1c029543f582b45037d145dd04. Resources: {'ram', 'instances', 'cores'} {{(pid=116368) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 16:32:19.897863 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-58597420-b5ca-40a9-9a8b-b644f3e3f84e tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Going to run 1 instances... {{(pid=116368) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 18 16:32:19.900305 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-58597420-b5ca-40a9-9a8b-b644f3e3f84e tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] [instance: 5b22c6de-2dc2-4f6e-99c1-733066ff2fe9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='900c4a9d-b6c6-451f-a509-eb4f4b49f459',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116368) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 18 16:32:19.962848 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-58597420-b5ca-40a9-9a8b-b644f3e3f84e tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.687179 Jan 18 16:32:19.970335 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 139/287] 10.222.0.82 () {60 vars in 1146 bytes} [Tue Jan 18 16:32:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 18 16:32:19.985691 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-c411fbae-f752-4ad6-be68-28008158137c tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:19.989000 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-c411fbae-f752-4ad6-be68-28008158137c tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] [instance: 5b22c6de-2dc2-4f6e-99c1-733066ff2fe9] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:20.176085 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-c411fbae-f752-4ad6-be68-28008158137c tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9b05b022da41bf84f2cdedc94af2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92e3a1c029543f582b45037d145dd04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:20.181338 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-17b66d45-23c1-4bb8-aec5-3f0ea4bded8f tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9424067ecef94af9ae0828b77926f675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74e7f75a7c41be9e4e3f6884b4d832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:20.183565 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-c411fbae-f752-4ad6-be68-28008158137c tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] 10.222.0.82 "GET /compute/v2.1/servers/5b22c6de-2dc2-4f6e-99c1-733066ff2fe9" status: 200 len: 1215 microversion: 2.1 time: 0.201640 Jan 18 16:32:20.184137 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 140/288] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:19 2022] GET /compute/v2.1/servers/5b22c6de-2dc2-4f6e-99c1-733066ff2fe9 => generated 1215 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:20.217582 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-17b66d45-23c1-4bb8-aec5-3f0ea4bded8f tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "GET /compute/v2.1/servers/c1375a98-670c-4cd0-ac9a-3f006da5670c" status: 200 len: 1314 microversion: 2.1 time: 0.371246 Jan 18 16:32:20.218531 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 149/289] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:19 2022] GET /compute/v2.1/servers/c1375a98-670c-4cd0-ac9a-3f006da5670c => generated 1314 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:32:20.406331 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-a2271beb-33c0-45b8-ac9f-a15894d554e6 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1856752470", "imageRef": "900c4a9d-b6c6-451f-a509-eb4f4b49f459", "flavorRef": "452", "networks": [{"uuid": "304974be-1692-42d6-8f0c-22abd422d9d8"}]}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:32:20.486350 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.network.neutron [None req-a2271beb-33c0-45b8-ac9f-a15894d554e6 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] validate_networks() for [('304974be-1692-42d6-8f0c-22abd422d9d8', None, None, None, None, None)] {{(pid=116368) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 18 16:32:20.774925 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-475cda6b-e6b2-4ce1-b286-9f53c184597c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:20.775736 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-475cda6b-e6b2-4ce1-b286-9f53c184597c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:20.785084 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-475cda6b-e6b2-4ce1-b286-9f53c184597c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:20.796311 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-475cda6b-e6b2-4ce1-b286-9f53c184597c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:20.797245 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-475cda6b-e6b2-4ce1-b286-9f53c184597c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:20.797684 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-475cda6b-e6b2-4ce1-b286-9f53c184597c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:21.208564 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-475cda6b-e6b2-4ce1-b286-9f53c184597c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:21.231342 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-475cda6b-e6b2-4ce1-b286-9f53c184597c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:21.238470 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-475cda6b-e6b2-4ce1-b286-9f53c184597c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:21.239951 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-475cda6b-e6b2-4ce1-b286-9f53c184597c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1745 microversion: 2.20 time: 0.469395 Jan 18 16:32:21.241705 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 150/290] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:32:20 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1745 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:32:21.247900 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [req-5c52bec8-1298-4658-915c-1fea3b61202d req-bcc731f1-b866-4a62-b48d-c0e6625af997 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1375a98-670c-4cd0-ac9a-3f006da5670c", "tag": "fbbf13fb-4363-443f-8c0b-3aae0e0a33a7"}]} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:32:21.249744 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:32:21.249744 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: warnings.warn(msg) Jan 18 16:32:21.262695 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-5c52bec8-1298-4658-915c-1fea3b61202d req-bcc731f1-b866-4a62-b48d-c0e6625af997 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:21.263421 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-5c52bec8-1298-4658-915c-1fea3b61202d req-bcc731f1-b866-4a62-b48d-c0e6625af997 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:21.276650 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.compute.server_external_events [req-5c52bec8-1298-4658-915c-1fea3b61202d req-bcc731f1-b866-4a62-b48d-c0e6625af997 service nova] Creating event network-changed:fbbf13fb-4363-443f-8c0b-3aae0e0a33a7 for instance c1375a98-670c-4cd0-ac9a-3f006da5670c on hv-cinder-78836 Jan 18 16:32:21.282340 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [req-5c52bec8-1298-4658-915c-1fea3b61202d req-bcc731f1-b866-4a62-b48d-c0e6625af997 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038853 Jan 18 16:32:21.283447 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 151/291] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:32:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:32:21.293947 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-5ab52cec-448f-4ef7-a45f-c4a4347b644e tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:21.295156 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-5ab52cec-448f-4ef7-a45f-c4a4347b644e tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] [instance: 5b22c6de-2dc2-4f6e-99c1-733066ff2fe9] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:21.299204 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-a2271beb-33c0-45b8-ac9f-a15894d554e6 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Flavor limits 0:0:0 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 18 16:32:21.299941 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-a2271beb-33c0-45b8-ac9f-a15894d554e6 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Image limits 0:0:0 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 18 16:32:21.300876 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-a2271beb-33c0-45b8-ac9f-a15894d554e6 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Flavor pref 0:0:0 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 18 16:32:21.301566 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-a2271beb-33c0-45b8-ac9f-a15894d554e6 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Image pref 0:0:0 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 18 16:32:21.302080 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-5ab52cec-448f-4ef7-a45f-c4a4347b644e tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:21.302430 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-a2271beb-33c0-45b8-ac9f-a15894d554e6 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 18 16:32:21.310171 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-5ab52cec-448f-4ef7-a45f-c4a4347b644e tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:21.311330 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-5ab52cec-448f-4ef7-a45f-c4a4347b644e tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:21.311936 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-5ab52cec-448f-4ef7-a45f-c4a4347b644e tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:21.325715 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a2271beb-33c0-45b8-ac9f-a15894d554e6 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:21.326612 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a2271beb-33c0-45b8-ac9f-a15894d554e6 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:21.335047 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a2271beb-33c0-45b8-ac9f-a15894d554e6 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:21.335958 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a2271beb-33c0-45b8-ac9f-a15894d554e6 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:21.363421 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.quota [None req-a2271beb-33c0-45b8-ac9f-a15894d554e6 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Getting quotas for project 417f505277c847cf9b6aaf89f1639bff. Resources: {'ram', 'instances', 'cores'} {{(pid=116368) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 16:32:21.370393 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.quota [None req-a2271beb-33c0-45b8-ac9f-a15894d554e6 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Getting quotas for user ebbc235b02424200b625af5b9995bbdb and project 417f505277c847cf9b6aaf89f1639bff. Resources: {'ram', 'instances', 'cores'} {{(pid=116368) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 16:32:21.394051 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-a2271beb-33c0-45b8-ac9f-a15894d554e6 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Going to run 1 instances... {{(pid=116368) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 18 16:32:21.396985 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-a2271beb-33c0-45b8-ac9f-a15894d554e6 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] [instance: 74592942-1569-4db1-bcdb-5f0cf97bea6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='900c4a9d-b6c6-451f-a509-eb4f4b49f459',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116368) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 18 16:32:21.465671 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-a2271beb-33c0-45b8-ac9f-a15894d554e6 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.063508 Jan 18 16:32:21.466750 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 141/292] 10.222.0.82 () {60 vars in 1146 bytes} [Tue Jan 18 16:32:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1065 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 18 16:32:21.477493 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-587d2944-c5e7-48cd-9dd7-cad0adb76296 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:21.481855 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-587d2944-c5e7-48cd-9dd7-cad0adb76296 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c1375a98-670c-4cd0-ac9a-3f006da5670c] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:21.491967 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-587d2944-c5e7-48cd-9dd7-cad0adb76296 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:21.492639 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-587d2944-c5e7-48cd-9dd7-cad0adb76296 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:21.493874 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-587d2944-c5e7-48cd-9dd7-cad0adb76296 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:21.494565 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-587d2944-c5e7-48cd-9dd7-cad0adb76296 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:21.515977 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-5ab52cec-448f-4ef7-a45f-c4a4347b644e tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9b05b022da41bf84f2cdedc94af2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92e3a1c029543f582b45037d145dd04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:21.543517 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-5ab52cec-448f-4ef7-a45f-c4a4347b644e tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] 10.222.0.82 "GET /compute/v2.1/servers/5b22c6de-2dc2-4f6e-99c1-733066ff2fe9" status: 200 len: 1275 microversion: 2.1 time: 0.257859 Jan 18 16:32:21.544117 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 152/293] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:21 2022] GET /compute/v2.1/servers/5b22c6de-2dc2-4f6e-99c1-733066ff2fe9 => generated 1275 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:21.577480 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-c85bf95f-e70c-4a38-9c90-dac808e75cbc tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:21.578390 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-c85bf95f-e70c-4a38-9c90-dac808e75cbc tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] [instance: 74592942-1569-4db1-bcdb-5f0cf97bea6e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:22.098140 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-c85bf95f-e70c-4a38-9c90-dac808e75cbc tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbc235b02424200b625af5b9995bbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417f505277c847cf9b6aaf89f1639bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:22.108738 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-c85bf95f-e70c-4a38-9c90-dac808e75cbc tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] 10.222.0.82 "GET /compute/v2.1/servers/74592942-1569-4db1-bcdb-5f0cf97bea6e" status: 200 len: 1219 microversion: 2.1 time: 0.548105 Jan 18 16:32:22.110052 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 153/294] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:21 2022] GET /compute/v2.1/servers/74592942-1569-4db1-bcdb-5f0cf97bea6e => generated 1219 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:22.260239 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-984f85d9-b4a3-43e4-85e2-638b491ea2a0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:22.266218 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-984f85d9-b4a3-43e4-85e2-638b491ea2a0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:22.281918 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-984f85d9-b4a3-43e4-85e2-638b491ea2a0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:22.282602 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-984f85d9-b4a3-43e4-85e2-638b491ea2a0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:22.283580 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-984f85d9-b4a3-43e4-85e2-638b491ea2a0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:22.286469 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-984f85d9-b4a3-43e4-85e2-638b491ea2a0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:22.359330 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-587d2944-c5e7-48cd-9dd7-cad0adb76296 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9424067ecef94af9ae0828b77926f675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74e7f75a7c41be9e4e3f6884b4d832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:22.371645 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-587d2944-c5e7-48cd-9dd7-cad0adb76296 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "GET /compute/v2.1/servers/c1375a98-670c-4cd0-ac9a-3f006da5670c" status: 200 len: 1314 microversion: 2.1 time: 0.903673 Jan 18 16:32:22.372354 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 142/295] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:21 2022] GET /compute/v2.1/servers/c1375a98-670c-4cd0-ac9a-3f006da5670c => generated 1314 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:22.562481 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-147dcfaf-9e13-437d-8ead-997323318954 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:22.563172 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-147dcfaf-9e13-437d-8ead-997323318954 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] [instance: 5b22c6de-2dc2-4f6e-99c1-733066ff2fe9] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:22.573726 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-147dcfaf-9e13-437d-8ead-997323318954 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:22.574798 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-147dcfaf-9e13-437d-8ead-997323318954 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:22.575644 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-147dcfaf-9e13-437d-8ead-997323318954 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:22.578276 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-147dcfaf-9e13-437d-8ead-997323318954 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:22.623695 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-984f85d9-b4a3-43e4-85e2-638b491ea2a0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:22.633877 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-984f85d9-b4a3-43e4-85e2-638b491ea2a0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:22.635360 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-984f85d9-b4a3-43e4-85e2-638b491ea2a0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:22.659901 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-984f85d9-b4a3-43e4-85e2-638b491ea2a0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1745 microversion: 2.20 time: 0.402419 Jan 18 16:32:22.661019 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 154/296] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:32:22 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1745 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:32:22.665777 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-ac1da336-9937-43ae-9ca5-3143310aaa0c tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-491918832", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-528604224", "security_groups": [{"name": "tempest-secgroup-smoke-2112687843"}], "block_device_mapping_v2": [{"uuid": "99f8d409-4548-4024-a716-0562d15f0fbf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1553074d-8be9-4ad2-b3ce-7b8026c06eda"}]}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:32:22.758909 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-147dcfaf-9e13-437d-8ead-997323318954 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9b05b022da41bf84f2cdedc94af2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92e3a1c029543f582b45037d145dd04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:22.779059 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-147dcfaf-9e13-437d-8ead-997323318954 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] 10.222.0.82 "GET /compute/v2.1/servers/5b22c6de-2dc2-4f6e-99c1-733066ff2fe9" status: 200 len: 1273 microversion: 2.1 time: 0.221891 Jan 18 16:32:22.785909 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 143/297] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:22 2022] GET /compute/v2.1/servers/5b22c6de-2dc2-4f6e-99c1-733066ff2fe9 => generated 1273 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:32:22.962782 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.network.neutron [None req-ac1da336-9937-43ae-9ca5-3143310aaa0c tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] validate_networks() for [('1553074d-8be9-4ad2-b3ce-7b8026c06eda', None, None, None, None, None)] {{(pid=116367) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 18 16:32:23.129539 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-2287bdc6-554d-4942-9009-5e09db61a3b7 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:23.130590 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-2287bdc6-554d-4942-9009-5e09db61a3b7 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] [instance: 74592942-1569-4db1-bcdb-5f0cf97bea6e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:23.142996 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-2287bdc6-554d-4942-9009-5e09db61a3b7 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:23.146656 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-2287bdc6-554d-4942-9009-5e09db61a3b7 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:23.147651 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-2287bdc6-554d-4942-9009-5e09db61a3b7 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:23.148447 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-2287bdc6-554d-4942-9009-5e09db61a3b7 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:23.264431 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-2287bdc6-554d-4942-9009-5e09db61a3b7 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbc235b02424200b625af5b9995bbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417f505277c847cf9b6aaf89f1639bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:23.280169 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-2287bdc6-554d-4942-9009-5e09db61a3b7 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] 10.222.0.82 "GET /compute/v2.1/servers/74592942-1569-4db1-bcdb-5f0cf97bea6e" status: 200 len: 1289 microversion: 2.1 time: 0.156531 Jan 18 16:32:23.295884 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 144/298] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:23 2022] GET /compute/v2.1/servers/74592942-1569-4db1-bcdb-5f0cf97bea6e => generated 1289 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:32:23.390362 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-877fea1e-03c8-48fa-8599-3f3e99bed30c tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:23.391432 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-877fea1e-03c8-48fa-8599-3f3e99bed30c tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c1375a98-670c-4cd0-ac9a-3f006da5670c] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:23.399606 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-877fea1e-03c8-48fa-8599-3f3e99bed30c tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:23.399937 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-877fea1e-03c8-48fa-8599-3f3e99bed30c tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:23.400858 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-877fea1e-03c8-48fa-8599-3f3e99bed30c tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:23.401450 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-877fea1e-03c8-48fa-8599-3f3e99bed30c tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:23.990971 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-877fea1e-03c8-48fa-8599-3f3e99bed30c tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9424067ecef94af9ae0828b77926f675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74e7f75a7c41be9e4e3f6884b4d832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:24.006293 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-877fea1e-03c8-48fa-8599-3f3e99bed30c tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "GET /compute/v2.1/servers/c1375a98-670c-4cd0-ac9a-3f006da5670c" status: 200 len: 1314 microversion: 2.1 time: 0.620513 Jan 18 16:32:24.007060 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 145/299] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:23 2022] GET /compute/v2.1/servers/c1375a98-670c-4cd0-ac9a-3f006da5670c => generated 1314 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:32:24.039031 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-289d8825-02ed-44bd-8a96-2fdd67e55645 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:24.039833 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-289d8825-02ed-44bd-8a96-2fdd67e55645 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:24.066628 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-289d8825-02ed-44bd-8a96-2fdd67e55645 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:24.069034 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-289d8825-02ed-44bd-8a96-2fdd67e55645 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:24.069902 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-289d8825-02ed-44bd-8a96-2fdd67e55645 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:24.070334 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-289d8825-02ed-44bd-8a96-2fdd67e55645 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:24.164519 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.virt.hardware [None req-ac1da336-9937-43ae-9ca5-3143310aaa0c tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Flavor limits 0:0:0 {{(pid=116367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 18 16:32:24.165503 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.virt.hardware [None req-ac1da336-9937-43ae-9ca5-3143310aaa0c tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Image limits 0:0:0 {{(pid=116367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 18 16:32:24.166071 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.virt.hardware [None req-ac1da336-9937-43ae-9ca5-3143310aaa0c tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Flavor pref 0:0:0 {{(pid=116367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 18 16:32:24.166680 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.virt.hardware [None req-ac1da336-9937-43ae-9ca5-3143310aaa0c tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Image pref 0:0:0 {{(pid=116367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 18 16:32:24.167189 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.virt.hardware [None req-ac1da336-9937-43ae-9ca5-3143310aaa0c tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 18 16:32:24.187139 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-ac1da336-9937-43ae-9ca5-3143310aaa0c tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:24.188469 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-ac1da336-9937-43ae-9ca5-3143310aaa0c tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:24.195232 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-ac1da336-9937-43ae-9ca5-3143310aaa0c tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:24.196047 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-ac1da336-9937-43ae-9ca5-3143310aaa0c tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:24.243515 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.quota [None req-ac1da336-9937-43ae-9ca5-3143310aaa0c tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Getting quotas for project 89b9ac86cb4c4f109b49c6f9a66379a4. Resources: {'ram', 'instances', 'cores'} {{(pid=116367) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 16:32:24.257152 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.quota [None req-ac1da336-9937-43ae-9ca5-3143310aaa0c tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Getting quotas for user 345686887fc3424fa518114e23f7fcc6 and project 89b9ac86cb4c4f109b49c6f9a66379a4. Resources: {'ram', 'instances', 'cores'} {{(pid=116367) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 16:32:24.422013 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-ac1da336-9937-43ae-9ca5-3143310aaa0c tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Going to run 1 instances... {{(pid=116367) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 18 16:32:24.425220 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-ac1da336-9937-43ae-9ca5-3143310aaa0c tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: 5b927087-6400-4a41-b19e-0e417905395e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='99f8d409-4548-4024-a716-0562d15f0fbf',volume_size=None,volume_type=None)] {{(pid=116367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 18 16:32:24.452290 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-289d8825-02ed-44bd-8a96-2fdd67e55645 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:24.469568 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-289d8825-02ed-44bd-8a96-2fdd67e55645 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:24.472577 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-289d8825-02ed-44bd-8a96-2fdd67e55645 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:24.474279 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-289d8825-02ed-44bd-8a96-2fdd67e55645 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1740 microversion: 2.20 time: 0.466408 Jan 18 16:32:24.477649 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 146/300] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:32:24 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1740 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:32:24.497486 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-5611aacd-c211-4e20-a1c3-bd2d90ef79a8 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:24.502497 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-5611aacd-c211-4e20-a1c3-bd2d90ef79a8 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] [instance: 5b22c6de-2dc2-4f6e-99c1-733066ff2fe9] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:24.520764 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-5611aacd-c211-4e20-a1c3-bd2d90ef79a8 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:24.521605 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-5611aacd-c211-4e20-a1c3-bd2d90ef79a8 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:24.522678 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-5611aacd-c211-4e20-a1c3-bd2d90ef79a8 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:24.523677 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-5611aacd-c211-4e20-a1c3-bd2d90ef79a8 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:24.752667 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-ac1da336-9937-43ae-9ca5-3143310aaa0c tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.090215 Jan 18 16:32:24.756264 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 155/301] 10.222.0.82 () {60 vars in 1146 bytes} [Tue Jan 18 16:32:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 2094 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 18 16:32:24.772825 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-5611aacd-c211-4e20-a1c3-bd2d90ef79a8 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9b05b022da41bf84f2cdedc94af2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92e3a1c029543f582b45037d145dd04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:24.774928 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-7d0b20fe-eb37-4813-a6f2-715494aebd84 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:24.775705 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-7d0b20fe-eb37-4813-a6f2-715494aebd84 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] [instance: 74592942-1569-4db1-bcdb-5f0cf97bea6e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:24.782155 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7d0b20fe-eb37-4813-a6f2-715494aebd84 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:24.782847 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7d0b20fe-eb37-4813-a6f2-715494aebd84 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:24.784383 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7d0b20fe-eb37-4813-a6f2-715494aebd84 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:24.785148 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7d0b20fe-eb37-4813-a6f2-715494aebd84 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:24.787332 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-5611aacd-c211-4e20-a1c3-bd2d90ef79a8 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] 10.222.0.82 "GET /compute/v2.1/servers/5b22c6de-2dc2-4f6e-99c1-733066ff2fe9" status: 200 len: 1315 microversion: 2.1 time: 0.307865 Jan 18 16:32:24.793913 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 147/302] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:24 2022] GET /compute/v2.1/servers/5b22c6de-2dc2-4f6e-99c1-733066ff2fe9 => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:24.798869 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-1a1a8e02-efd5-4fb4-8f99-94f8a80bbc8d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:32:24.800582 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-1a1a8e02-efd5-4fb4-8f99-94f8a80bbc8d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:24.819404 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1a1a8e02-efd5-4fb4-8f99-94f8a80bbc8d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:24.820038 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1a1a8e02-efd5-4fb4-8f99-94f8a80bbc8d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:24.821045 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1a1a8e02-efd5-4fb4-8f99-94f8a80bbc8d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:24.822784 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1a1a8e02-efd5-4fb4-8f99-94f8a80bbc8d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:24.883018 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.objects.instance [None req-1a1a8e02-efd5-4fb4-8f99-94f8a80bbc8d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lazy-loading 'flavor' on Instance uuid c862639d-6995-43e1-9c7a-3d4f416629fc {{(pid=116368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 18 16:32:24.994259 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-7d0b20fe-eb37-4813-a6f2-715494aebd84 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbc235b02424200b625af5b9995bbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417f505277c847cf9b6aaf89f1639bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:25.005265 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-7d0b20fe-eb37-4813-a6f2-715494aebd84 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] 10.222.0.82 "GET /compute/v2.1/servers/74592942-1569-4db1-bcdb-5f0cf97bea6e" status: 200 len: 1277 microversion: 2.1 time: 0.244623 Jan 18 16:32:25.005845 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 156/303] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:24 2022] GET /compute/v2.1/servers/74592942-1569-4db1-bcdb-5f0cf97bea6e => generated 1277 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:25.021716 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [req-1f1957ef-decf-4fb5-a3c3-d75d1fe8d014 req-0d9f69a3-7faa-49af-8b1c-2771552ffbfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e9ca525-aad0-4ac6-8879-2c8d0131c2ee", "name": "network-vif-plugged", "status": "completed", "tag": "ca2a0420-8660-4c5a-8bc5-c3d7fa2913eb"}]} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:32:25.023807 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:32:25.023807 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: warnings.warn(msg) Jan 18 16:32:25.051667 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-1f1957ef-decf-4fb5-a3c3-d75d1fe8d014 req-0d9f69a3-7faa-49af-8b1c-2771552ffbfb service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:25.052103 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-1f1957ef-decf-4fb5-a3c3-d75d1fe8d014 req-0d9f69a3-7faa-49af-8b1c-2771552ffbfb service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:25.089669 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.compute.server_external_events [req-1f1957ef-decf-4fb5-a3c3-d75d1fe8d014 req-0d9f69a3-7faa-49af-8b1c-2771552ffbfb service nova] Creating event network-vif-plugged:ca2a0420-8660-4c5a-8bc5-c3d7fa2913eb for instance 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee on hv-cinder-78836 Jan 18 16:32:25.109155 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [req-1f1957ef-decf-4fb5-a3c3-d75d1fe8d014 req-0d9f69a3-7faa-49af-8b1c-2771552ffbfb service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091364 Jan 18 16:32:25.109896 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 157/304] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:32:25.134949 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-e9d197b9-e71b-4747-8fd0-1aeda396fad4 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:25.136025 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-e9d197b9-e71b-4747-8fd0-1aeda396fad4 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: 5b927087-6400-4a41-b19e-0e417905395e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:25.275899 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-e9d197b9-e71b-4747-8fd0-1aeda396fad4 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:25.289328 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-e9d197b9-e71b-4747-8fd0-1aeda396fad4 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e" status: 200 len: 1093 microversion: 2.1 time: 0.177307 Jan 18 16:32:25.291791 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 158/305] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:25 2022] GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e => generated 1093 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:25.309777 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-1a1a8e02-efd5-4fb4-8f99-94f8a80bbc8d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "POST /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc/action" status: 200 len: 32 microversion: 2.1 time: 0.514831 Jan 18 16:32:25.310777 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-6bc6901c-d8fa-42b5-a312-bc13cb067992 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:25.311366 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 148/306] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:32:24 2022] POST /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc/action => generated 32 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 18 16:32:25.312934 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-6bc6901c-d8fa-42b5-a312-bc13cb067992 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c1375a98-670c-4cd0-ac9a-3f006da5670c] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:25.323734 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-e9ee3367-7c1a-4141-bd06-5475dcf954f7 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:25.327494 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-e9ee3367-7c1a-4141-bd06-5475dcf954f7 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:25.345425 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e9ee3367-7c1a-4141-bd06-5475dcf954f7 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:25.346784 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e9ee3367-7c1a-4141-bd06-5475dcf954f7 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:25.348004 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e9ee3367-7c1a-4141-bd06-5475dcf954f7 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:25.348838 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6bc6901c-d8fa-42b5-a312-bc13cb067992 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:25.349513 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6bc6901c-d8fa-42b5-a312-bc13cb067992 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:25.350584 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6bc6901c-d8fa-42b5-a312-bc13cb067992 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:25.351166 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6bc6901c-d8fa-42b5-a312-bc13cb067992 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:25.358919 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e9ee3367-7c1a-4141-bd06-5475dcf954f7 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:25.953916 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-6bc6901c-d8fa-42b5-a312-bc13cb067992 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9424067ecef94af9ae0828b77926f675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74e7f75a7c41be9e4e3f6884b4d832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:25.963405 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-6bc6901c-d8fa-42b5-a312-bc13cb067992 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "GET /compute/v2.1/servers/c1375a98-670c-4cd0-ac9a-3f006da5670c" status: 200 len: 1314 microversion: 2.1 time: 0.670317 Jan 18 16:32:25.968395 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 159/307] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:25 2022] GET /compute/v2.1/servers/c1375a98-670c-4cd0-ac9a-3f006da5670c => generated 1314 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:25.981862 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-327062a1-b699-4841-a856-96735525d0f8 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:25.982477 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-327062a1-b699-4841-a856-96735525d0f8 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:25.994874 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-327062a1-b699-4841-a856-96735525d0f8 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:25.995328 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-327062a1-b699-4841-a856-96735525d0f8 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:25.996128 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-327062a1-b699-4841-a856-96735525d0f8 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:25.996556 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-327062a1-b699-4841-a856-96735525d0f8 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:26.026134 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-e9ee3367-7c1a-4141-bd06-5475dcf954f7 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:26.040472 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-e9ee3367-7c1a-4141-bd06-5475dcf954f7 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1566 microversion: 2.1 time: 0.722962 Jan 18 16:32:26.045504 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 149/308] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:25 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1566 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:32:26.067642 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-699795b1-653d-4fd5-98cf-212cea8723ff tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:26.071106 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-699795b1-653d-4fd5-98cf-212cea8723ff tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] [instance: 5b22c6de-2dc2-4f6e-99c1-733066ff2fe9] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:26.095163 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-699795b1-653d-4fd5-98cf-212cea8723ff tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:26.096286 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-699795b1-653d-4fd5-98cf-212cea8723ff tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:26.102672 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-699795b1-653d-4fd5-98cf-212cea8723ff tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:26.103518 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-699795b1-653d-4fd5-98cf-212cea8723ff tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:26.462786 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-327062a1-b699-4841-a856-96735525d0f8 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:26.475758 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-327062a1-b699-4841-a856-96735525d0f8 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:26.482675 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-327062a1-b699-4841-a856-96735525d0f8 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:26.487483 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-327062a1-b699-4841-a856-96735525d0f8 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1740 microversion: 2.20 time: 0.516978 Jan 18 16:32:26.489831 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 160/309] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:32:25 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1740 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:32:26.504350 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-2fccecf3-b935-49c6-a9e7-439e61f13553 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:26.505330 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-2fccecf3-b935-49c6-a9e7-439e61f13553 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] [instance: 74592942-1569-4db1-bcdb-5f0cf97bea6e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:26.522127 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2fccecf3-b935-49c6-a9e7-439e61f13553 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:26.524384 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2fccecf3-b935-49c6-a9e7-439e61f13553 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:26.525546 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2fccecf3-b935-49c6-a9e7-439e61f13553 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:26.527751 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2fccecf3-b935-49c6-a9e7-439e61f13553 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:26.695116 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-699795b1-653d-4fd5-98cf-212cea8723ff tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9b05b022da41bf84f2cdedc94af2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92e3a1c029543f582b45037d145dd04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:26.717742 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-699795b1-653d-4fd5-98cf-212cea8723ff tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] 10.222.0.82 "GET /compute/v2.1/servers/5b22c6de-2dc2-4f6e-99c1-733066ff2fe9" status: 200 len: 1315 microversion: 2.1 time: 0.663095 Jan 18 16:32:26.731227 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 150/310] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:26 2022] GET /compute/v2.1/servers/5b22c6de-2dc2-4f6e-99c1-733066ff2fe9 => generated 1315 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:26.737566 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-1a7bf6da-1696-43a3-a5ca-990507f98cbd tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:26.738586 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-1a7bf6da-1696-43a3-a5ca-990507f98cbd tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: 5b927087-6400-4a41-b19e-0e417905395e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:26.747986 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1a7bf6da-1696-43a3-a5ca-990507f98cbd tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:26.748840 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1a7bf6da-1696-43a3-a5ca-990507f98cbd tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:26.749839 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1a7bf6da-1696-43a3-a5ca-990507f98cbd tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:26.777844 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1a7bf6da-1696-43a3-a5ca-990507f98cbd tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:26.937102 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-2fccecf3-b935-49c6-a9e7-439e61f13553 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbc235b02424200b625af5b9995bbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417f505277c847cf9b6aaf89f1639bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:26.948446 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-2fccecf3-b935-49c6-a9e7-439e61f13553 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] 10.222.0.82 "GET /compute/v2.1/servers/74592942-1569-4db1-bcdb-5f0cf97bea6e" status: 200 len: 1319 microversion: 2.1 time: 0.455199 Jan 18 16:32:26.950429 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 161/311] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:26 2022] GET /compute/v2.1/servers/74592942-1569-4db1-bcdb-5f0cf97bea6e => generated 1319 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:26.954883 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-1a7bf6da-1696-43a3-a5ca-990507f98cbd tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:26.963342 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-1a7bf6da-1696-43a3-a5ca-990507f98cbd tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e" status: 200 len: 1209 microversion: 2.1 time: 0.230963 Jan 18 16:32:26.976855 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 151/312] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:26 2022] GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e => generated 1209 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:26.984324 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-714a3958-3b50-4a40-9ffe-496580ae63e7 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:26.984866 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-714a3958-3b50-4a40-9ffe-496580ae63e7 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c1375a98-670c-4cd0-ac9a-3f006da5670c] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:26.993000 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-714a3958-3b50-4a40-9ffe-496580ae63e7 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:26.993708 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-714a3958-3b50-4a40-9ffe-496580ae63e7 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:26.995948 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-714a3958-3b50-4a40-9ffe-496580ae63e7 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:26.996404 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-714a3958-3b50-4a40-9ffe-496580ae63e7 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:27.063825 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-a398368b-9319-418b-b8db-59de8886e0c4 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:27.064601 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-a398368b-9319-418b-b8db-59de8886e0c4 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:27.081169 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a398368b-9319-418b-b8db-59de8886e0c4 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:27.083821 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a398368b-9319-418b-b8db-59de8886e0c4 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:27.087104 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a398368b-9319-418b-b8db-59de8886e0c4 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:27.088513 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a398368b-9319-418b-b8db-59de8886e0c4 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:27.297135 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-714a3958-3b50-4a40-9ffe-496580ae63e7 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9424067ecef94af9ae0828b77926f675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74e7f75a7c41be9e4e3f6884b4d832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:27.305909 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-714a3958-3b50-4a40-9ffe-496580ae63e7 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "GET /compute/v2.1/servers/c1375a98-670c-4cd0-ac9a-3f006da5670c" status: 200 len: 1314 microversion: 2.1 time: 0.325502 Jan 18 16:32:27.317848 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 162/313] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:26 2022] GET /compute/v2.1/servers/c1375a98-670c-4cd0-ac9a-3f006da5670c => generated 1314 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:27.507886 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-728e10d9-4b0d-4808-b9ad-7ca88393dc94 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:27.508530 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-728e10d9-4b0d-4808-b9ad-7ca88393dc94 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:27.524516 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-728e10d9-4b0d-4808-b9ad-7ca88393dc94 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:27.525296 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-728e10d9-4b0d-4808-b9ad-7ca88393dc94 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:27.526362 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-728e10d9-4b0d-4808-b9ad-7ca88393dc94 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:27.526948 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-728e10d9-4b0d-4808-b9ad-7ca88393dc94 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:27.544310 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-a398368b-9319-418b-b8db-59de8886e0c4 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:27.559824 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-a398368b-9319-418b-b8db-59de8886e0c4 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1566 microversion: 2.1 time: 0.499959 Jan 18 16:32:27.561471 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 152/314] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:27 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1566 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:27.741038 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-8b15341f-88d4-47b5-80bc-cee2dc2e9c73 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:27.742440 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-8b15341f-88d4-47b5-80bc-cee2dc2e9c73 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] [instance: 5b22c6de-2dc2-4f6e-99c1-733066ff2fe9] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:27.759978 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8b15341f-88d4-47b5-80bc-cee2dc2e9c73 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:27.760995 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8b15341f-88d4-47b5-80bc-cee2dc2e9c73 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:27.764517 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8b15341f-88d4-47b5-80bc-cee2dc2e9c73 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:27.765208 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8b15341f-88d4-47b5-80bc-cee2dc2e9c73 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:27.907476 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-728e10d9-4b0d-4808-b9ad-7ca88393dc94 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:27.915992 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-728e10d9-4b0d-4808-b9ad-7ca88393dc94 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:27.917505 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-728e10d9-4b0d-4808-b9ad-7ca88393dc94 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:27.929945 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-728e10d9-4b0d-4808-b9ad-7ca88393dc94 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1740 microversion: 2.20 time: 0.425465 Jan 18 16:32:27.930884 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 163/315] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:32:27 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1740 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 16:32:27.967081 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-27d8c499-9f16-4963-8ae2-b71d8367678f tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:27.967999 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-27d8c499-9f16-4963-8ae2-b71d8367678f tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] [instance: 74592942-1569-4db1-bcdb-5f0cf97bea6e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:27.978906 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-27d8c499-9f16-4963-8ae2-b71d8367678f tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:27.980862 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-27d8c499-9f16-4963-8ae2-b71d8367678f tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:27.982367 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-27d8c499-9f16-4963-8ae2-b71d8367678f tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:27.984729 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-27d8c499-9f16-4963-8ae2-b71d8367678f tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:28.047973 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-8b15341f-88d4-47b5-80bc-cee2dc2e9c73 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9b05b022da41bf84f2cdedc94af2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92e3a1c029543f582b45037d145dd04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:28.059138 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-8b15341f-88d4-47b5-80bc-cee2dc2e9c73 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] 10.222.0.82 "GET /compute/v2.1/servers/5b22c6de-2dc2-4f6e-99c1-733066ff2fe9" status: 200 len: 1315 microversion: 2.1 time: 0.324349 Jan 18 16:32:28.071343 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 153/316] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:27 2022] GET /compute/v2.1/servers/5b22c6de-2dc2-4f6e-99c1-733066ff2fe9 => generated 1315 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:28.091730 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-14b68875-f2a0-4847-8938-e6738b656003 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:28.093510 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-14b68875-f2a0-4847-8938-e6738b656003 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: 5b927087-6400-4a41-b19e-0e417905395e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:28.113880 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-14b68875-f2a0-4847-8938-e6738b656003 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:28.119717 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-14b68875-f2a0-4847-8938-e6738b656003 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:28.123283 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-14b68875-f2a0-4847-8938-e6738b656003 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:28.124400 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-14b68875-f2a0-4847-8938-e6738b656003 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:28.578169 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-14b68875-f2a0-4847-8938-e6738b656003 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:28.589814 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-14b68875-f2a0-4847-8938-e6738b656003 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e" status: 200 len: 1197 microversion: 2.1 time: 0.514020 Jan 18 16:32:28.591577 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 154/317] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:28 2022] GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e => generated 1197 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:28.612782 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-f4d926b4-1808-450e-a441-1dbc04930e73 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:28.613853 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-f4d926b4-1808-450e-a441-1dbc04930e73 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c1375a98-670c-4cd0-ac9a-3f006da5670c] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:28.621483 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f4d926b4-1808-450e-a441-1dbc04930e73 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:28.622796 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f4d926b4-1808-450e-a441-1dbc04930e73 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:28.623857 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f4d926b4-1808-450e-a441-1dbc04930e73 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:28.624631 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f4d926b4-1808-450e-a441-1dbc04930e73 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:28.646587 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-27d8c499-9f16-4963-8ae2-b71d8367678f tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbc235b02424200b625af5b9995bbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417f505277c847cf9b6aaf89f1639bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:28.658125 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-27d8c499-9f16-4963-8ae2-b71d8367678f tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] 10.222.0.82 "GET /compute/v2.1/servers/74592942-1569-4db1-bcdb-5f0cf97bea6e" status: 200 len: 1319 microversion: 2.1 time: 0.694299 Jan 18 16:32:28.670412 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 164/318] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:27 2022] GET /compute/v2.1/servers/74592942-1569-4db1-bcdb-5f0cf97bea6e => generated 1319 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:32:28.678045 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-82abda7b-f803-4f5b-8b5c-46ccc57ca823 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:28.678872 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-82abda7b-f803-4f5b-8b5c-46ccc57ca823 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:28.685635 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-82abda7b-f803-4f5b-8b5c-46ccc57ca823 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:28.686383 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-82abda7b-f803-4f5b-8b5c-46ccc57ca823 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:28.687877 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-82abda7b-f803-4f5b-8b5c-46ccc57ca823 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:28.688484 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-82abda7b-f803-4f5b-8b5c-46ccc57ca823 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:28.997996 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-f4d926b4-1808-450e-a441-1dbc04930e73 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9424067ecef94af9ae0828b77926f675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74e7f75a7c41be9e4e3f6884b4d832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:29.010168 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-f4d926b4-1808-450e-a441-1dbc04930e73 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "GET /compute/v2.1/servers/c1375a98-670c-4cd0-ac9a-3f006da5670c" status: 200 len: 1314 microversion: 2.1 time: 0.417274 Jan 18 16:32:29.018788 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 155/319] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:28 2022] GET /compute/v2.1/servers/c1375a98-670c-4cd0-ac9a-3f006da5670c => generated 1314 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:29.026350 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [req-0b0bf42c-2890-46fd-92cf-b0bd18155bee req-249a6c32-d7f3-4a5d-9e3f-cbfae9c33eda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b22c6de-2dc2-4f6e-99c1-733066ff2fe9", "tag": "d6be0e64-7cfa-4b6c-9ce0-2103385f693f"}]} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:32:29.028473 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:32:29.028473 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: warnings.warn(msg) Jan 18 16:32:29.048126 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-0b0bf42c-2890-46fd-92cf-b0bd18155bee req-249a6c32-d7f3-4a5d-9e3f-cbfae9c33eda service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:29.050918 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-0b0bf42c-2890-46fd-92cf-b0bd18155bee req-249a6c32-d7f3-4a5d-9e3f-cbfae9c33eda service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:29.078535 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.compute.server_external_events [req-0b0bf42c-2890-46fd-92cf-b0bd18155bee req-249a6c32-d7f3-4a5d-9e3f-cbfae9c33eda service nova] Creating event network-changed:d6be0e64-7cfa-4b6c-9ce0-2103385f693f for instance 5b22c6de-2dc2-4f6e-99c1-733066ff2fe9 on hv-cinder-78836 Jan 18 16:32:29.078790 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-82abda7b-f803-4f5b-8b5c-46ccc57ca823 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:29.088740 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-82abda7b-f803-4f5b-8b5c-46ccc57ca823 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1566 microversion: 2.1 time: 0.416289 Jan 18 16:32:29.089402 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 165/320] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:28 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1566 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:29.095839 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [req-0b0bf42c-2890-46fd-92cf-b0bd18155bee req-249a6c32-d7f3-4a5d-9e3f-cbfae9c33eda service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065592 Jan 18 16:32:29.097019 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 156/321] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:32:29.103345 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-f86c6d1a-8750-4253-a2e0-e670cfddf83d tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:29.104372 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-f86c6d1a-8750-4253-a2e0-e670cfddf83d tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] [instance: 5b22c6de-2dc2-4f6e-99c1-733066ff2fe9] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:29.107169 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-64e10345-6e76-4e03-87d4-46dae5fb1c2f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:29.108889 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-64e10345-6e76-4e03-87d4-46dae5fb1c2f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:29.112517 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f86c6d1a-8750-4253-a2e0-e670cfddf83d tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:29.113510 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f86c6d1a-8750-4253-a2e0-e670cfddf83d tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:29.114514 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f86c6d1a-8750-4253-a2e0-e670cfddf83d tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:29.115113 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f86c6d1a-8750-4253-a2e0-e670cfddf83d tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:29.121517 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-64e10345-6e76-4e03-87d4-46dae5fb1c2f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:29.121964 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-64e10345-6e76-4e03-87d4-46dae5fb1c2f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:29.124888 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-64e10345-6e76-4e03-87d4-46dae5fb1c2f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:29.125366 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-64e10345-6e76-4e03-87d4-46dae5fb1c2f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:29.420574 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-f86c6d1a-8750-4253-a2e0-e670cfddf83d tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9b05b022da41bf84f2cdedc94af2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92e3a1c029543f582b45037d145dd04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:29.434212 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-64e10345-6e76-4e03-87d4-46dae5fb1c2f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:29.439789 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-f86c6d1a-8750-4253-a2e0-e670cfddf83d tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] 10.222.0.82 "GET /compute/v2.1/servers/5b22c6de-2dc2-4f6e-99c1-733066ff2fe9" status: 200 len: 1315 microversion: 2.1 time: 0.341225 Jan 18 16:32:29.446342 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-64e10345-6e76-4e03-87d4-46dae5fb1c2f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:29.446979 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 157/322] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:29 2022] GET /compute/v2.1/servers/5b22c6de-2dc2-4f6e-99c1-733066ff2fe9 => generated 1315 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:29.447936 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-64e10345-6e76-4e03-87d4-46dae5fb1c2f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:29.451346 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-64e10345-6e76-4e03-87d4-46dae5fb1c2f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1740 microversion: 2.20 time: 0.350813 Jan 18 16:32:29.452460 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 166/323] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:32:29 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1740 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:32:29.607355 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-f3c209b5-3450-4433-9e91-7297ec767175 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:29.607972 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-f3c209b5-3450-4433-9e91-7297ec767175 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: 5b927087-6400-4a41-b19e-0e417905395e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:29.623396 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f3c209b5-3450-4433-9e91-7297ec767175 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:29.625494 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f3c209b5-3450-4433-9e91-7297ec767175 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:29.631781 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f3c209b5-3450-4433-9e91-7297ec767175 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:29.633748 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f3c209b5-3450-4433-9e91-7297ec767175 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:29.677710 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-9a7a8bd3-0bdb-4949-88a9-3ae0e877b400 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:29.678326 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-9a7a8bd3-0bdb-4949-88a9-3ae0e877b400 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] [instance: 74592942-1569-4db1-bcdb-5f0cf97bea6e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:29.686811 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-9a7a8bd3-0bdb-4949-88a9-3ae0e877b400 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:29.687268 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-9a7a8bd3-0bdb-4949-88a9-3ae0e877b400 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:29.701694 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-9a7a8bd3-0bdb-4949-88a9-3ae0e877b400 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:29.702379 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-9a7a8bd3-0bdb-4949-88a9-3ae0e877b400 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:29.861694 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-f3c209b5-3450-4433-9e91-7297ec767175 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:29.871804 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-f3c209b5-3450-4433-9e91-7297ec767175 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e" status: 200 len: 1197 microversion: 2.1 time: 0.267994 Jan 18 16:32:29.875596 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 158/324] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:29 2022] GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e => generated 1197 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:30.031906 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-961d2b95-49c7-483a-a24b-de20891c5993 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:30.037321 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-961d2b95-49c7-483a-a24b-de20891c5993 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c1375a98-670c-4cd0-ac9a-3f006da5670c] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:30.048303 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-961d2b95-49c7-483a-a24b-de20891c5993 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:30.051542 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-961d2b95-49c7-483a-a24b-de20891c5993 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:30.052394 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-961d2b95-49c7-483a-a24b-de20891c5993 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:30.052832 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-961d2b95-49c7-483a-a24b-de20891c5993 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:30.062744 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-9a7a8bd3-0bdb-4949-88a9-3ae0e877b400 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbc235b02424200b625af5b9995bbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417f505277c847cf9b6aaf89f1639bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:30.072298 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-9a7a8bd3-0bdb-4949-88a9-3ae0e877b400 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] 10.222.0.82 "GET /compute/v2.1/servers/74592942-1569-4db1-bcdb-5f0cf97bea6e" status: 200 len: 1319 microversion: 2.1 time: 0.398693 Jan 18 16:32:30.074285 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 167/325] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:29 2022] GET /compute/v2.1/servers/74592942-1569-4db1-bcdb-5f0cf97bea6e => generated 1319 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:30.106855 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-bbdd3469-a72d-47af-b931-c35ea238f5d2 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:30.107732 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-bbdd3469-a72d-47af-b931-c35ea238f5d2 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:30.116081 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-bbdd3469-a72d-47af-b931-c35ea238f5d2 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:30.121638 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-bbdd3469-a72d-47af-b931-c35ea238f5d2 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:30.122724 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-bbdd3469-a72d-47af-b931-c35ea238f5d2 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:30.123406 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-bbdd3469-a72d-47af-b931-c35ea238f5d2 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:30.442047 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-bbdd3469-a72d-47af-b931-c35ea238f5d2 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:30.454971 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-bbdd3469-a72d-47af-b931-c35ea238f5d2 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1566 microversion: 2.1 time: 0.351896 Jan 18 16:32:30.463330 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 168/326] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:30 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1566 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:32:30.481966 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [req-13aad99b-9530-400b-b3a5-31521b66c13c req-8eb30e6e-2c17-40cb-bfb4-881ac45cbab2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1375a98-670c-4cd0-ac9a-3f006da5670c", "name": "network-vif-plugged", "status": "completed", "tag": "fbbf13fb-4363-443f-8c0b-3aae0e0a33a7"}]} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:32:30.487819 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:32:30.487819 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: warnings.warn(msg) Jan 18 16:32:30.528455 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-961d2b95-49c7-483a-a24b-de20891c5993 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9424067ecef94af9ae0828b77926f675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74e7f75a7c41be9e4e3f6884b4d832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:30.531591 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-13aad99b-9530-400b-b3a5-31521b66c13c req-8eb30e6e-2c17-40cb-bfb4-881ac45cbab2 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:30.535747 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-13aad99b-9530-400b-b3a5-31521b66c13c req-8eb30e6e-2c17-40cb-bfb4-881ac45cbab2 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:30.540984 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-961d2b95-49c7-483a-a24b-de20891c5993 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "GET /compute/v2.1/servers/c1375a98-670c-4cd0-ac9a-3f006da5670c" status: 200 len: 1314 microversion: 2.1 time: 0.512747 Jan 18 16:32:30.546994 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 159/327] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:30 2022] GET /compute/v2.1/servers/c1375a98-670c-4cd0-ac9a-3f006da5670c => generated 1314 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:30.564221 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-23cf29c1-a843-4c1a-b336-105d35694a4e tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:30.566924 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-23cf29c1-a843-4c1a-b336-105d35694a4e tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] [instance: 5b22c6de-2dc2-4f6e-99c1-733066ff2fe9] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:30.578186 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.compute.server_external_events [req-13aad99b-9530-400b-b3a5-31521b66c13c req-8eb30e6e-2c17-40cb-bfb4-881ac45cbab2 service nova] Creating event network-vif-plugged:fbbf13fb-4363-443f-8c0b-3aae0e0a33a7 for instance c1375a98-670c-4cd0-ac9a-3f006da5670c on hv-cinder-78836 Jan 18 16:32:30.580703 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-23cf29c1-a843-4c1a-b336-105d35694a4e tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:30.582752 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-23cf29c1-a843-4c1a-b336-105d35694a4e tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:30.584626 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [req-13aad99b-9530-400b-b3a5-31521b66c13c req-8eb30e6e-2c17-40cb-bfb4-881ac45cbab2 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119678 Jan 18 16:32:30.586086 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 169/328] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:32:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:32:30.587298 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-23cf29c1-a843-4c1a-b336-105d35694a4e tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:30.591963 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-23cf29c1-a843-4c1a-b336-105d35694a4e tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:30.597715 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-6d65e6e3-8dbd-44cb-adf4-87fe09fe74ff tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:30.600293 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-6d65e6e3-8dbd-44cb-adf4-87fe09fe74ff tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:30.628639 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6d65e6e3-8dbd-44cb-adf4-87fe09fe74ff tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:30.630107 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6d65e6e3-8dbd-44cb-adf4-87fe09fe74ff tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:30.631164 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6d65e6e3-8dbd-44cb-adf4-87fe09fe74ff tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:30.631835 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6d65e6e3-8dbd-44cb-adf4-87fe09fe74ff tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:31.095661 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-23cf29c1-a843-4c1a-b336-105d35694a4e tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9b05b022da41bf84f2cdedc94af2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92e3a1c029543f582b45037d145dd04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:31.104012 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-23cf29c1-a843-4c1a-b336-105d35694a4e tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] 10.222.0.82 "GET /compute/v2.1/servers/5b22c6de-2dc2-4f6e-99c1-733066ff2fe9" status: 200 len: 1315 microversion: 2.1 time: 0.555601 Jan 18 16:32:31.108017 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 160/329] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:30 2022] GET /compute/v2.1/servers/5b22c6de-2dc2-4f6e-99c1-733066ff2fe9 => generated 1315 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:31.119399 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-bb57cccd-9a9f-45e3-b16c-3c93625cb7f7 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:31.120290 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-bb57cccd-9a9f-45e3-b16c-3c93625cb7f7 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: 5b927087-6400-4a41-b19e-0e417905395e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:31.139570 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-bb57cccd-9a9f-45e3-b16c-3c93625cb7f7 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:31.140024 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-bb57cccd-9a9f-45e3-b16c-3c93625cb7f7 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:31.140832 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-bb57cccd-9a9f-45e3-b16c-3c93625cb7f7 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:31.141275 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-bb57cccd-9a9f-45e3-b16c-3c93625cb7f7 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:31.256279 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-6d65e6e3-8dbd-44cb-adf4-87fe09fe74ff tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:31.264912 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-6d65e6e3-8dbd-44cb-adf4-87fe09fe74ff tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:31.270485 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-6d65e6e3-8dbd-44cb-adf4-87fe09fe74ff tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:31.274407 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-6d65e6e3-8dbd-44cb-adf4-87fe09fe74ff tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1740 microversion: 2.20 time: 0.686088 Jan 18 16:32:31.275090 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 170/330] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:32:30 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1740 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:32:31.279499 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-bd7d0373-c8fd-46e0-815c-99c2a86549fc tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:31.287267 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-bd7d0373-c8fd-46e0-815c-99c2a86549fc tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] [instance: 74592942-1569-4db1-bcdb-5f0cf97bea6e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:31.305524 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-bd7d0373-c8fd-46e0-815c-99c2a86549fc tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:31.306297 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-bd7d0373-c8fd-46e0-815c-99c2a86549fc tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:31.307305 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-bd7d0373-c8fd-46e0-815c-99c2a86549fc tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:31.307796 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-bd7d0373-c8fd-46e0-815c-99c2a86549fc tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:31.410903 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-bb57cccd-9a9f-45e3-b16c-3c93625cb7f7 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:31.429735 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-bb57cccd-9a9f-45e3-b16c-3c93625cb7f7 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e" status: 200 len: 1265 microversion: 2.1 time: 0.319196 Jan 18 16:32:31.430904 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 161/331] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:31 2022] GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e => generated 1265 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:31.437328 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [req-70d2c38f-1894-4c0d-bf8b-b24b30e01d65 req-bb4ed51e-65d8-446f-82a5-e896e537b00a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74592942-1569-4db1-bcdb-5f0cf97bea6e", "tag": "5ab2fdd2-12ac-4769-9cb1-77cabf1c426b"}]} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:32:31.440139 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:32:31.440139 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: warnings.warn(msg) Jan 18 16:32:31.462080 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-70d2c38f-1894-4c0d-bf8b-b24b30e01d65 req-bb4ed51e-65d8-446f-82a5-e896e537b00a service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:31.462861 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-70d2c38f-1894-4c0d-bf8b-b24b30e01d65 req-bb4ed51e-65d8-446f-82a5-e896e537b00a service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:31.482189 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.compute.server_external_events [req-70d2c38f-1894-4c0d-bf8b-b24b30e01d65 req-bb4ed51e-65d8-446f-82a5-e896e537b00a service nova] Creating event network-changed:5ab2fdd2-12ac-4769-9cb1-77cabf1c426b for instance 74592942-1569-4db1-bcdb-5f0cf97bea6e on hv-cinder-78836 Jan 18 16:32:31.490215 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [req-70d2c38f-1894-4c0d-bf8b-b24b30e01d65 req-bb4ed51e-65d8-446f-82a5-e896e537b00a service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056783 Jan 18 16:32:31.492350 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 162/332] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:32:31.499157 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-bd7d0373-c8fd-46e0-815c-99c2a86549fc tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbc235b02424200b625af5b9995bbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417f505277c847cf9b6aaf89f1639bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:31.507942 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-bd7d0373-c8fd-46e0-815c-99c2a86549fc tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] 10.222.0.82 "GET /compute/v2.1/servers/74592942-1569-4db1-bcdb-5f0cf97bea6e" status: 200 len: 1319 microversion: 2.1 time: 0.231704 Jan 18 16:32:31.508655 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-6480c7ca-8522-4acb-af7e-ef6f2612478d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:31.508871 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 171/333] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:31 2022] GET /compute/v2.1/servers/74592942-1569-4db1-bcdb-5f0cf97bea6e => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:31.509725 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-6480c7ca-8522-4acb-af7e-ef6f2612478d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:31.515888 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-6480c7ca-8522-4acb-af7e-ef6f2612478d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:31.516403 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-6480c7ca-8522-4acb-af7e-ef6f2612478d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:31.517324 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-6480c7ca-8522-4acb-af7e-ef6f2612478d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:31.517774 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-6480c7ca-8522-4acb-af7e-ef6f2612478d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:31.566728 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-4e29935d-5495-4c74-9c87-ce509e50a61c tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:31.567647 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-4e29935d-5495-4c74-9c87-ce509e50a61c tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c1375a98-670c-4cd0-ac9a-3f006da5670c] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:31.581927 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4e29935d-5495-4c74-9c87-ce509e50a61c tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:31.582858 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4e29935d-5495-4c74-9c87-ce509e50a61c tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:31.583917 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4e29935d-5495-4c74-9c87-ce509e50a61c tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:31.584594 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4e29935d-5495-4c74-9c87-ce509e50a61c tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:31.704279 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-6480c7ca-8522-4acb-af7e-ef6f2612478d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:31.713132 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-6480c7ca-8522-4acb-af7e-ef6f2612478d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1566 microversion: 2.1 time: 0.217634 Jan 18 16:32:31.714385 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 163/334] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:31 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1566 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:31.800978 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-4e29935d-5495-4c74-9c87-ce509e50a61c tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9424067ecef94af9ae0828b77926f675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74e7f75a7c41be9e4e3f6884b4d832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:31.811392 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-4e29935d-5495-4c74-9c87-ce509e50a61c tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "GET /compute/v2.1/servers/c1375a98-670c-4cd0-ac9a-3f006da5670c" status: 200 len: 1314 microversion: 2.1 time: 0.249126 Jan 18 16:32:31.812092 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 172/335] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:31 2022] GET /compute/v2.1/servers/c1375a98-670c-4cd0-ac9a-3f006da5670c => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:32:32.126592 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-1531312d-b714-4ff7-b5a8-ba0f2486fe4e tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:32.127609 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-1531312d-b714-4ff7-b5a8-ba0f2486fe4e tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] [instance: 5b22c6de-2dc2-4f6e-99c1-733066ff2fe9] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:32.133572 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1531312d-b714-4ff7-b5a8-ba0f2486fe4e tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:32.134212 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1531312d-b714-4ff7-b5a8-ba0f2486fe4e tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:32.134811 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1531312d-b714-4ff7-b5a8-ba0f2486fe4e tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:32.135211 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1531312d-b714-4ff7-b5a8-ba0f2486fe4e tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:32.293155 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-3d0c03c0-be51-4ce1-bf3a-d0ceb804db66 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:32.293980 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-3d0c03c0-be51-4ce1-bf3a-d0ceb804db66 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:32.304697 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-3d0c03c0-be51-4ce1-bf3a-d0ceb804db66 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:32.305281 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-3d0c03c0-be51-4ce1-bf3a-d0ceb804db66 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:32.306929 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-3d0c03c0-be51-4ce1-bf3a-d0ceb804db66 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:32.309495 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-3d0c03c0-be51-4ce1-bf3a-d0ceb804db66 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:32.348123 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-1531312d-b714-4ff7-b5a8-ba0f2486fe4e tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9b05b022da41bf84f2cdedc94af2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92e3a1c029543f582b45037d145dd04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:32.357387 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-1531312d-b714-4ff7-b5a8-ba0f2486fe4e tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] 10.222.0.82 "GET /compute/v2.1/servers/5b22c6de-2dc2-4f6e-99c1-733066ff2fe9" status: 200 len: 1315 microversion: 2.1 time: 0.234328 Jan 18 16:32:32.358285 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 164/336] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:32 2022] GET /compute/v2.1/servers/5b22c6de-2dc2-4f6e-99c1-733066ff2fe9 => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:32.447781 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-85a7dafe-b64b-4502-a0f1-b261fb8f8b09 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:32.449167 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-85a7dafe-b64b-4502-a0f1-b261fb8f8b09 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: 5b927087-6400-4a41-b19e-0e417905395e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:32.459631 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-85a7dafe-b64b-4502-a0f1-b261fb8f8b09 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:32.460318 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-85a7dafe-b64b-4502-a0f1-b261fb8f8b09 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:32.461985 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-85a7dafe-b64b-4502-a0f1-b261fb8f8b09 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:32.462767 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-85a7dafe-b64b-4502-a0f1-b261fb8f8b09 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:32.525764 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-3d0c03c0-be51-4ce1-bf3a-d0ceb804db66 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:32.535876 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-3d0c03c0-be51-4ce1-bf3a-d0ceb804db66 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:32.537916 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-3d0c03c0-be51-4ce1-bf3a-d0ceb804db66 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:32.539255 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-3d0c03c0-be51-4ce1-bf3a-d0ceb804db66 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1740 microversion: 2.20 time: 0.250428 Jan 18 16:32:32.540483 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 173/337] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:32:32 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1740 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 16:32:32.560362 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-adef817b-092c-4072-acae-cb32fec6a2fe tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:32.561183 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-adef817b-092c-4072-acae-cb32fec6a2fe tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] [instance: 74592942-1569-4db1-bcdb-5f0cf97bea6e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:32.569308 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-adef817b-092c-4072-acae-cb32fec6a2fe tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:32.569974 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-adef817b-092c-4072-acae-cb32fec6a2fe tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:32.571121 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-adef817b-092c-4072-acae-cb32fec6a2fe tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:32.571799 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-adef817b-092c-4072-acae-cb32fec6a2fe tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:32.850038 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-85a7dafe-b64b-4502-a0f1-b261fb8f8b09 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:32.864857 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-85a7dafe-b64b-4502-a0f1-b261fb8f8b09 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e" status: 200 len: 1265 microversion: 2.1 time: 0.421282 Jan 18 16:32:32.865990 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 165/338] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:32 2022] GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e => generated 1265 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:32:32.873595 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-ae1f1e36-265c-4ffe-87f5-28bf33ed37da tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:32.876509 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-ae1f1e36-265c-4ffe-87f5-28bf33ed37da tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:32.897917 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ae1f1e36-265c-4ffe-87f5-28bf33ed37da tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:32.900133 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ae1f1e36-265c-4ffe-87f5-28bf33ed37da tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:32.902332 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ae1f1e36-265c-4ffe-87f5-28bf33ed37da tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:32.905500 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ae1f1e36-265c-4ffe-87f5-28bf33ed37da tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:32.948350 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-adef817b-092c-4072-acae-cb32fec6a2fe tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbc235b02424200b625af5b9995bbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417f505277c847cf9b6aaf89f1639bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:32.960011 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-adef817b-092c-4072-acae-cb32fec6a2fe tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] 10.222.0.82 "GET /compute/v2.1/servers/74592942-1569-4db1-bcdb-5f0cf97bea6e" status: 200 len: 1319 microversion: 2.1 time: 0.418188 Jan 18 16:32:32.960867 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 174/339] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:32 2022] GET /compute/v2.1/servers/74592942-1569-4db1-bcdb-5f0cf97bea6e => generated 1319 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:32.978392 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-09f5ec0f-4302-49ee-bb7a-b26535e3ac42 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:32.981756 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-09f5ec0f-4302-49ee-bb7a-b26535e3ac42 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c1375a98-670c-4cd0-ac9a-3f006da5670c] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:33.015287 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-09f5ec0f-4302-49ee-bb7a-b26535e3ac42 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:33.016541 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-09f5ec0f-4302-49ee-bb7a-b26535e3ac42 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:33.017688 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-09f5ec0f-4302-49ee-bb7a-b26535e3ac42 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:33.018986 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-09f5ec0f-4302-49ee-bb7a-b26535e3ac42 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:33.243842 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-ae1f1e36-265c-4ffe-87f5-28bf33ed37da tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:33.259295 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-ae1f1e36-265c-4ffe-87f5-28bf33ed37da tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1566 microversion: 2.1 time: 0.392024 Jan 18 16:32:33.259880 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 166/340] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:32 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1566 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:33.306975 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-09f5ec0f-4302-49ee-bb7a-b26535e3ac42 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9424067ecef94af9ae0828b77926f675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74e7f75a7c41be9e4e3f6884b4d832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:33.317043 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-09f5ec0f-4302-49ee-bb7a-b26535e3ac42 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "GET /compute/v2.1/servers/c1375a98-670c-4cd0-ac9a-3f006da5670c" status: 200 len: 1499 microversion: 2.1 time: 0.353254 Jan 18 16:32:33.318136 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 175/341] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:32 2022] GET /compute/v2.1/servers/c1375a98-670c-4cd0-ac9a-3f006da5670c => generated 1499 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:33.376575 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-30002725-6944-4fd8-becd-9c666a9e8986 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:33.379297 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-30002725-6944-4fd8-becd-9c666a9e8986 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] [instance: 5b22c6de-2dc2-4f6e-99c1-733066ff2fe9] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:33.390877 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-30002725-6944-4fd8-becd-9c666a9e8986 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:33.391730 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-30002725-6944-4fd8-becd-9c666a9e8986 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:33.393161 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-30002725-6944-4fd8-becd-9c666a9e8986 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:33.394043 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-30002725-6944-4fd8-becd-9c666a9e8986 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:33.561076 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-578b8e0d-8d1e-44a8-a728-67dc9a9d1f1d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:33.562088 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-578b8e0d-8d1e-44a8-a728-67dc9a9d1f1d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:33.583272 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-578b8e0d-8d1e-44a8-a728-67dc9a9d1f1d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:33.584048 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-578b8e0d-8d1e-44a8-a728-67dc9a9d1f1d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:33.587280 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-578b8e0d-8d1e-44a8-a728-67dc9a9d1f1d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:33.588425 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-578b8e0d-8d1e-44a8-a728-67dc9a9d1f1d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:33.742749 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-30002725-6944-4fd8-becd-9c666a9e8986 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9b05b022da41bf84f2cdedc94af2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92e3a1c029543f582b45037d145dd04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:33.752108 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-30002725-6944-4fd8-becd-9c666a9e8986 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] 10.222.0.82 "GET /compute/v2.1/servers/5b22c6de-2dc2-4f6e-99c1-733066ff2fe9" status: 200 len: 1315 microversion: 2.1 time: 0.380754 Jan 18 16:32:33.755621 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 167/342] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:33 2022] GET /compute/v2.1/servers/5b22c6de-2dc2-4f6e-99c1-733066ff2fe9 => generated 1315 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:33.884016 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-d33ed776-8697-4094-8582-9ffe0fa3bd20 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:33.884838 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-d33ed776-8697-4094-8582-9ffe0fa3bd20 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: 5b927087-6400-4a41-b19e-0e417905395e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:33.893168 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d33ed776-8697-4094-8582-9ffe0fa3bd20 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:33.905151 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d33ed776-8697-4094-8582-9ffe0fa3bd20 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:33.906229 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d33ed776-8697-4094-8582-9ffe0fa3bd20 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:33.907128 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d33ed776-8697-4094-8582-9ffe0fa3bd20 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:33.925140 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-578b8e0d-8d1e-44a8-a728-67dc9a9d1f1d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:33.943078 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-578b8e0d-8d1e-44a8-a728-67dc9a9d1f1d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:33.946930 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-578b8e0d-8d1e-44a8-a728-67dc9a9d1f1d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:33.954517 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-578b8e0d-8d1e-44a8-a728-67dc9a9d1f1d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1740 microversion: 2.20 time: 0.399441 Jan 18 16:32:33.957796 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 176/343] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:32:33 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1740 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:32:33.986305 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-1f8eb487-4931-439e-b56a-fd8db1377d4c tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:33.986585 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-1f8eb487-4931-439e-b56a-fd8db1377d4c tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] [instance: 74592942-1569-4db1-bcdb-5f0cf97bea6e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:33.999736 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-1f8eb487-4931-439e-b56a-fd8db1377d4c tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:34.001391 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-1f8eb487-4931-439e-b56a-fd8db1377d4c tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:34.003047 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-1f8eb487-4931-439e-b56a-fd8db1377d4c tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:34.003486 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-1f8eb487-4931-439e-b56a-fd8db1377d4c tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:34.270684 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-d33ed776-8697-4094-8582-9ffe0fa3bd20 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:34.281310 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-d33ed776-8697-4094-8582-9ffe0fa3bd20 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e" status: 200 len: 1265 microversion: 2.1 time: 0.402730 Jan 18 16:32:34.282615 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 168/344] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:33 2022] GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e => generated 1265 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:34.288285 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-8057d7f0-8741-4d24-b263-5119a62b2cd1 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:34.289076 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-8057d7f0-8741-4d24-b263-5119a62b2cd1 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c1375a98-670c-4cd0-ac9a-3f006da5670c] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:34.296480 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8057d7f0-8741-4d24-b263-5119a62b2cd1 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:34.298672 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8057d7f0-8741-4d24-b263-5119a62b2cd1 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:34.300307 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8057d7f0-8741-4d24-b263-5119a62b2cd1 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:34.301004 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8057d7f0-8741-4d24-b263-5119a62b2cd1 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:34.342469 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-8057d7f0-8741-4d24-b263-5119a62b2cd1 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c1375a98-670c-4cd0-ac9a-3f006da5670c] Going to try to terminate instance {{(pid=116368) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 18 16:32:34.417860 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-1f8eb487-4931-439e-b56a-fd8db1377d4c tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbc235b02424200b625af5b9995bbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417f505277c847cf9b6aaf89f1639bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:34.427954 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-1f8eb487-4931-439e-b56a-fd8db1377d4c tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] 10.222.0.82 "GET /compute/v2.1/servers/74592942-1569-4db1-bcdb-5f0cf97bea6e" status: 200 len: 1319 microversion: 2.1 time: 0.453209 Jan 18 16:32:34.430243 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 177/345] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:33 2022] GET /compute/v2.1/servers/74592942-1569-4db1-bcdb-5f0cf97bea6e => generated 1319 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:34.435732 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-0482ecd4-a56d-4a48-a5cf-68f09284d18b tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:34.436664 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-0482ecd4-a56d-4a48-a5cf-68f09284d18b tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:34.449071 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0482ecd4-a56d-4a48-a5cf-68f09284d18b tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:34.449851 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0482ecd4-a56d-4a48-a5cf-68f09284d18b tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:34.451327 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0482ecd4-a56d-4a48-a5cf-68f09284d18b tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:34.451953 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0482ecd4-a56d-4a48-a5cf-68f09284d18b tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:34.538253 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-8057d7f0-8741-4d24-b263-5119a62b2cd1 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "DELETE /compute/v2.1/servers/c1375a98-670c-4cd0-ac9a-3f006da5670c" status: 204 len: 0 microversion: 2.1 time: 0.252693 Jan 18 16:32:34.538672 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 169/346] 10.222.0.82 () {58 vars in 1238 bytes} [Tue Jan 18 16:32:34 2022] DELETE /compute/v2.1/servers/c1375a98-670c-4cd0-ac9a-3f006da5670c => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 18 16:32:34.558433 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-c4aca36d-1df0-48b9-8879-44117a8567a5 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:34.559567 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-c4aca36d-1df0-48b9-8879-44117a8567a5 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c1375a98-670c-4cd0-ac9a-3f006da5670c] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:34.570422 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c4aca36d-1df0-48b9-8879-44117a8567a5 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:34.582386 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c4aca36d-1df0-48b9-8879-44117a8567a5 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:34.583492 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c4aca36d-1df0-48b9-8879-44117a8567a5 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:34.584564 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c4aca36d-1df0-48b9-8879-44117a8567a5 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:34.637192 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-0482ecd4-a56d-4a48-a5cf-68f09284d18b tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:34.649555 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-0482ecd4-a56d-4a48-a5cf-68f09284d18b tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1566 microversion: 2.1 time: 0.216547 Jan 18 16:32:34.650498 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 178/347] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:34 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1566 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:34.772149 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-0768b045-0f7b-48bd-ac45-cf1b597ec6b4 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:34.774387 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-0768b045-0f7b-48bd-ac45-cf1b597ec6b4 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] [instance: 5b22c6de-2dc2-4f6e-99c1-733066ff2fe9] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:34.786686 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0768b045-0f7b-48bd-ac45-cf1b597ec6b4 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:34.789476 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0768b045-0f7b-48bd-ac45-cf1b597ec6b4 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:34.790667 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0768b045-0f7b-48bd-ac45-cf1b597ec6b4 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:34.791451 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0768b045-0f7b-48bd-ac45-cf1b597ec6b4 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:34.856676 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-c4aca36d-1df0-48b9-8879-44117a8567a5 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9424067ecef94af9ae0828b77926f675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74e7f75a7c41be9e4e3f6884b4d832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:34.871376 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-c4aca36d-1df0-48b9-8879-44117a8567a5 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "GET /compute/v2.1/servers/c1375a98-670c-4cd0-ac9a-3f006da5670c" status: 200 len: 1505 microversion: 2.1 time: 0.327430 Jan 18 16:32:34.883872 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 170/348] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:34 2022] GET /compute/v2.1/servers/c1375a98-670c-4cd0-ac9a-3f006da5670c => generated 1505 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:34.976870 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-972f0d1d-dc8a-40e0-94be-7d261fe03f41 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:34.977518 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-972f0d1d-dc8a-40e0-94be-7d261fe03f41 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:34.984985 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-972f0d1d-dc8a-40e0-94be-7d261fe03f41 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:34.985446 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-972f0d1d-dc8a-40e0-94be-7d261fe03f41 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:34.986246 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-972f0d1d-dc8a-40e0-94be-7d261fe03f41 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:34.987457 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-972f0d1d-dc8a-40e0-94be-7d261fe03f41 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:35.045844 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-0768b045-0f7b-48bd-ac45-cf1b597ec6b4 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9b05b022da41bf84f2cdedc94af2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92e3a1c029543f582b45037d145dd04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:35.055738 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-0768b045-0f7b-48bd-ac45-cf1b597ec6b4 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] 10.222.0.82 "GET /compute/v2.1/servers/5b22c6de-2dc2-4f6e-99c1-733066ff2fe9" status: 200 len: 1315 microversion: 2.1 time: 0.287989 Jan 18 16:32:35.057894 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 179/349] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:34 2022] GET /compute/v2.1/servers/5b22c6de-2dc2-4f6e-99c1-733066ff2fe9 => generated 1315 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:32:35.136487 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [req-28938e18-c908-4ede-956e-74da9083137c req-88e4c5ec-e575-4a18-b6eb-a655a41b159d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b927087-6400-4a41-b19e-0e417905395e", "tag": "0e5fd19d-7b69-41f6-849c-97ce9658dc29"}]} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:32:35.138605 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:32:35.138605 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: warnings.warn(msg) Jan 18 16:32:35.172200 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-28938e18-c908-4ede-956e-74da9083137c req-88e4c5ec-e575-4a18-b6eb-a655a41b159d service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:35.172983 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-28938e18-c908-4ede-956e-74da9083137c req-88e4c5ec-e575-4a18-b6eb-a655a41b159d service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:35.218041 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.compute.server_external_events [req-28938e18-c908-4ede-956e-74da9083137c req-88e4c5ec-e575-4a18-b6eb-a655a41b159d service nova] Creating event network-changed:0e5fd19d-7b69-41f6-849c-97ce9658dc29 for instance 5b927087-6400-4a41-b19e-0e417905395e on hv-cinder-78836 Jan 18 16:32:35.237687 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [req-28938e18-c908-4ede-956e-74da9083137c req-88e4c5ec-e575-4a18-b6eb-a655a41b159d service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102505 Jan 18 16:32:35.242713 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 180/350] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 16:32:35.270247 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-972f0d1d-dc8a-40e0-94be-7d261fe03f41 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:35.280163 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-972f0d1d-dc8a-40e0-94be-7d261fe03f41 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:35.284995 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-972f0d1d-dc8a-40e0-94be-7d261fe03f41 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:35.288017 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-972f0d1d-dc8a-40e0-94be-7d261fe03f41 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1740 microversion: 2.20 time: 0.317301 Jan 18 16:32:35.289667 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 171/351] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:32:34 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1740 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:32:35.301016 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-193be973-744c-4271-9fe7-f427a7970d5b tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:35.302674 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-193be973-744c-4271-9fe7-f427a7970d5b tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: 5b927087-6400-4a41-b19e-0e417905395e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:35.316967 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-193be973-744c-4271-9fe7-f427a7970d5b tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:35.317682 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-193be973-744c-4271-9fe7-f427a7970d5b tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:35.318643 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-193be973-744c-4271-9fe7-f427a7970d5b tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:35.319076 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-193be973-744c-4271-9fe7-f427a7970d5b tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:35.446258 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-069e1484-e4f4-4eda-9347-1de541ab5255 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:35.447114 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-069e1484-e4f4-4eda-9347-1de541ab5255 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] [instance: 74592942-1569-4db1-bcdb-5f0cf97bea6e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:35.456864 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-069e1484-e4f4-4eda-9347-1de541ab5255 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:35.458828 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-069e1484-e4f4-4eda-9347-1de541ab5255 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:35.470096 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-069e1484-e4f4-4eda-9347-1de541ab5255 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:35.470896 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-069e1484-e4f4-4eda-9347-1de541ab5255 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:35.607910 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-193be973-744c-4271-9fe7-f427a7970d5b tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:35.628350 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-193be973-744c-4271-9fe7-f427a7970d5b tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e" status: 200 len: 1265 microversion: 2.1 time: 0.332350 Jan 18 16:32:35.641089 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 181/352] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:35 2022] GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e => generated 1265 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:35.673346 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-76316ce3-063c-40bf-aa94-02ded10a3d66 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:35.675975 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-76316ce3-063c-40bf-aa94-02ded10a3d66 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:35.687790 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-069e1484-e4f4-4eda-9347-1de541ab5255 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbc235b02424200b625af5b9995bbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417f505277c847cf9b6aaf89f1639bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:35.700585 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-069e1484-e4f4-4eda-9347-1de541ab5255 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] 10.222.0.82 "GET /compute/v2.1/servers/74592942-1569-4db1-bcdb-5f0cf97bea6e" status: 200 len: 1319 microversion: 2.1 time: 0.257837 Jan 18 16:32:35.704107 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 172/353] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:35 2022] GET /compute/v2.1/servers/74592942-1569-4db1-bcdb-5f0cf97bea6e => generated 1319 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:35.723562 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-76316ce3-063c-40bf-aa94-02ded10a3d66 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:35.733712 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-76316ce3-063c-40bf-aa94-02ded10a3d66 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:35.753205 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-76316ce3-063c-40bf-aa94-02ded10a3d66 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:35.754475 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-76316ce3-063c-40bf-aa94-02ded10a3d66 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:35.889447 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-bee2c1c5-d511-40ee-abbe-d1144d491b87 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:35.890314 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-bee2c1c5-d511-40ee-abbe-d1144d491b87 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c1375a98-670c-4cd0-ac9a-3f006da5670c] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:35.897792 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-bee2c1c5-d511-40ee-abbe-d1144d491b87 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:35.906571 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-bee2c1c5-d511-40ee-abbe-d1144d491b87 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:35.909978 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-bee2c1c5-d511-40ee-abbe-d1144d491b87 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:35.915996 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-bee2c1c5-d511-40ee-abbe-d1144d491b87 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:36.212667 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-76316ce3-063c-40bf-aa94-02ded10a3d66 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:36.226079 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-76316ce3-063c-40bf-aa94-02ded10a3d66 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1566 microversion: 2.1 time: 0.558527 Jan 18 16:32:36.230489 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 182/354] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:35 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1566 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:32:36.263910 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-987e8849-421a-44de-bb83-1f31fa1edf06 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:36.264903 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-987e8849-421a-44de-bb83-1f31fa1edf06 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] [instance: 5b22c6de-2dc2-4f6e-99c1-733066ff2fe9] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:36.278236 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-987e8849-421a-44de-bb83-1f31fa1edf06 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:36.279041 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-987e8849-421a-44de-bb83-1f31fa1edf06 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:36.299305 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-987e8849-421a-44de-bb83-1f31fa1edf06 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:36.299869 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-987e8849-421a-44de-bb83-1f31fa1edf06 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:36.374018 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-bee2c1c5-d511-40ee-abbe-d1144d491b87 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9424067ecef94af9ae0828b77926f675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74e7f75a7c41be9e4e3f6884b4d832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:36.391010 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-bee2c1c5-d511-40ee-abbe-d1144d491b87 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "GET /compute/v2.1/servers/c1375a98-670c-4cd0-ac9a-3f006da5670c" status: 200 len: 1505 microversion: 2.1 time: 0.502194 Jan 18 16:32:36.394245 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 173/355] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:35 2022] GET /compute/v2.1/servers/c1375a98-670c-4cd0-ac9a-3f006da5670c => generated 1505 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:36.414618 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-46bb0b53-6e62-418c-a6ba-c0c9ebcdbc1b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:36.415495 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-46bb0b53-6e62-418c-a6ba-c0c9ebcdbc1b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:36.438039 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-46bb0b53-6e62-418c-a6ba-c0c9ebcdbc1b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:36.439947 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-46bb0b53-6e62-418c-a6ba-c0c9ebcdbc1b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:36.449895 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-46bb0b53-6e62-418c-a6ba-c0c9ebcdbc1b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:36.450855 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-46bb0b53-6e62-418c-a6ba-c0c9ebcdbc1b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:36.748838 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-987e8849-421a-44de-bb83-1f31fa1edf06 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9b05b022da41bf84f2cdedc94af2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92e3a1c029543f582b45037d145dd04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:36.760913 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-987e8849-421a-44de-bb83-1f31fa1edf06 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] 10.222.0.82 "GET /compute/v2.1/servers/5b22c6de-2dc2-4f6e-99c1-733066ff2fe9" status: 200 len: 1315 microversion: 2.1 time: 0.504255 Jan 18 16:32:36.761891 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 183/356] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:36 2022] GET /compute/v2.1/servers/5b22c6de-2dc2-4f6e-99c1-733066ff2fe9 => generated 1315 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:36.766733 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-75ea99a3-068c-42a5-a717-378544ab3fa0 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:36.776024 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-75ea99a3-068c-42a5-a717-378544ab3fa0 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: 5b927087-6400-4a41-b19e-0e417905395e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:36.786088 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-75ea99a3-068c-42a5-a717-378544ab3fa0 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:36.793936 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-75ea99a3-068c-42a5-a717-378544ab3fa0 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:36.797429 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-75ea99a3-068c-42a5-a717-378544ab3fa0 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:36.798169 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-75ea99a3-068c-42a5-a717-378544ab3fa0 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:36.889566 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-46bb0b53-6e62-418c-a6ba-c0c9ebcdbc1b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:36.903547 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-46bb0b53-6e62-418c-a6ba-c0c9ebcdbc1b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:36.911992 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-46bb0b53-6e62-418c-a6ba-c0c9ebcdbc1b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:36.920697 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-46bb0b53-6e62-418c-a6ba-c0c9ebcdbc1b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1740 microversion: 2.20 time: 0.524054 Jan 18 16:32:36.926071 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 174/357] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:32:36 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1740 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:32:36.939035 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-5cea8c84-2284-48cb-8969-ed7e0929bceb tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:36.942563 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-5cea8c84-2284-48cb-8969-ed7e0929bceb tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] [instance: 74592942-1569-4db1-bcdb-5f0cf97bea6e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:36.969018 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-5cea8c84-2284-48cb-8969-ed7e0929bceb tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:36.969930 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-5cea8c84-2284-48cb-8969-ed7e0929bceb tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:36.970986 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-5cea8c84-2284-48cb-8969-ed7e0929bceb tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:36.973658 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-5cea8c84-2284-48cb-8969-ed7e0929bceb tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:37.169726 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-75ea99a3-068c-42a5-a717-378544ab3fa0 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:37.179032 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-75ea99a3-068c-42a5-a717-378544ab3fa0 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e" status: 200 len: 1265 microversion: 2.1 time: 0.415765 Jan 18 16:32:37.183159 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 184/358] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:36 2022] GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e => generated 1265 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:37.191482 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [req-a6249fc8-af5a-4580-975c-d67f66532e85 req-b5226a63-8ec4-472e-af5f-ea921816b0cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b22c6de-2dc2-4f6e-99c1-733066ff2fe9", "name": "network-vif-plugged", "status": "completed", "tag": "d6be0e64-7cfa-4b6c-9ce0-2103385f693f"}]} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:32:37.198843 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:32:37.198843 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: warnings.warn(msg) Jan 18 16:32:37.219689 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-a6249fc8-af5a-4580-975c-d67f66532e85 req-b5226a63-8ec4-472e-af5f-ea921816b0cc service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:37.220310 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-a6249fc8-af5a-4580-975c-d67f66532e85 req-b5226a63-8ec4-472e-af5f-ea921816b0cc service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:37.264092 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.compute.server_external_events [req-a6249fc8-af5a-4580-975c-d67f66532e85 req-b5226a63-8ec4-472e-af5f-ea921816b0cc service nova] Creating event network-vif-plugged:d6be0e64-7cfa-4b6c-9ce0-2103385f693f for instance 5b22c6de-2dc2-4f6e-99c1-733066ff2fe9 on hv-cinder-78836 Jan 18 16:32:37.272693 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [req-a6249fc8-af5a-4580-975c-d67f66532e85 req-b5226a63-8ec4-472e-af5f-ea921816b0cc service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088071 Jan 18 16:32:37.275734 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 185/359] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:32:37.292425 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-31af458e-a6db-4d34-982a-e810d3a71903 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:37.294064 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-31af458e-a6db-4d34-982a-e810d3a71903 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:37.310041 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-31af458e-a6db-4d34-982a-e810d3a71903 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:37.311034 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-31af458e-a6db-4d34-982a-e810d3a71903 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:37.313926 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-31af458e-a6db-4d34-982a-e810d3a71903 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:37.315246 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-31af458e-a6db-4d34-982a-e810d3a71903 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:37.417842 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-5cea8c84-2284-48cb-8969-ed7e0929bceb tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbc235b02424200b625af5b9995bbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417f505277c847cf9b6aaf89f1639bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:37.434754 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-5cea8c84-2284-48cb-8969-ed7e0929bceb tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] 10.222.0.82 "GET /compute/v2.1/servers/74592942-1569-4db1-bcdb-5f0cf97bea6e" status: 200 len: 1319 microversion: 2.1 time: 0.507022 Jan 18 16:32:37.438021 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 175/360] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:36 2022] GET /compute/v2.1/servers/74592942-1569-4db1-bcdb-5f0cf97bea6e => generated 1319 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:37.450190 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-d49f1fc6-23b1-420c-a4d0-1c7eb094984d tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:37.452593 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-d49f1fc6-23b1-420c-a4d0-1c7eb094984d tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c1375a98-670c-4cd0-ac9a-3f006da5670c] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:37.465951 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d49f1fc6-23b1-420c-a4d0-1c7eb094984d tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:37.468531 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d49f1fc6-23b1-420c-a4d0-1c7eb094984d tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:37.471433 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d49f1fc6-23b1-420c-a4d0-1c7eb094984d tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:37.473284 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d49f1fc6-23b1-420c-a4d0-1c7eb094984d tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:38.478616 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-31af458e-a6db-4d34-982a-e810d3a71903 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:38.525929 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-31af458e-a6db-4d34-982a-e810d3a71903 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1566 microversion: 2.1 time: 1.246609 Jan 18 16:32:38.534394 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-d49f1fc6-23b1-420c-a4d0-1c7eb094984d tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9424067ecef94af9ae0828b77926f675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74e7f75a7c41be9e4e3f6884b4d832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:38.548597 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 186/361] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:37 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1566 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:38.559509 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-d49f1fc6-23b1-420c-a4d0-1c7eb094984d tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "GET /compute/v2.1/servers/c1375a98-670c-4cd0-ac9a-3f006da5670c" status: 200 len: 1505 microversion: 2.1 time: 1.117000 Jan 18 16:32:38.573657 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 176/362] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:37 2022] GET /compute/v2.1/servers/c1375a98-670c-4cd0-ac9a-3f006da5670c => generated 1505 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:38.574825 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-792cbd72-6931-4865-a7fb-9affb272f3df tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:38.580753 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-792cbd72-6931-4865-a7fb-9affb272f3df tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] [instance: 5b22c6de-2dc2-4f6e-99c1-733066ff2fe9] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:38.584979 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-2e2abcd9-2892-481a-b25a-55ab5a6e9b94 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:38.586090 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-2e2abcd9-2892-481a-b25a-55ab5a6e9b94 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:38.598651 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-792cbd72-6931-4865-a7fb-9affb272f3df tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:38.604855 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-792cbd72-6931-4865-a7fb-9affb272f3df tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:38.606834 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-2e2abcd9-2892-481a-b25a-55ab5a6e9b94 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:38.608051 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-792cbd72-6931-4865-a7fb-9affb272f3df tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:38.608525 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-792cbd72-6931-4865-a7fb-9affb272f3df tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:38.613627 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-2e2abcd9-2892-481a-b25a-55ab5a6e9b94 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:38.615500 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-2e2abcd9-2892-481a-b25a-55ab5a6e9b94 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:38.617332 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-2e2abcd9-2892-481a-b25a-55ab5a6e9b94 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:39.009664 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-792cbd72-6931-4865-a7fb-9affb272f3df tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9b05b022da41bf84f2cdedc94af2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92e3a1c029543f582b45037d145dd04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:39.017149 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-792cbd72-6931-4865-a7fb-9affb272f3df tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] 10.222.0.82 "GET /compute/v2.1/servers/5b22c6de-2dc2-4f6e-99c1-733066ff2fe9" status: 200 len: 1315 microversion: 2.1 time: 0.457744 Jan 18 16:32:39.019070 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 187/363] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:38 2022] GET /compute/v2.1/servers/5b22c6de-2dc2-4f6e-99c1-733066ff2fe9 => generated 1315 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:39.027999 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-4dd37b08-ae02-4f3b-9e9c-4af14ddcac28 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:39.036098 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-2e2abcd9-2892-481a-b25a-55ab5a6e9b94 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:39.040547 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-4dd37b08-ae02-4f3b-9e9c-4af14ddcac28 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: 5b927087-6400-4a41-b19e-0e417905395e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:39.055260 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-2e2abcd9-2892-481a-b25a-55ab5a6e9b94 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:39.060846 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-2e2abcd9-2892-481a-b25a-55ab5a6e9b94 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:39.064381 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4dd37b08-ae02-4f3b-9e9c-4af14ddcac28 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:39.066925 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-2e2abcd9-2892-481a-b25a-55ab5a6e9b94 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1740 microversion: 2.20 time: 0.500481 Jan 18 16:32:39.067908 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 177/364] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:32:38 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1740 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:32:39.068642 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4dd37b08-ae02-4f3b-9e9c-4af14ddcac28 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:39.073268 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-2ea0ca23-7806-40e0-9e88-aff26d15ed43 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:39.074446 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4dd37b08-ae02-4f3b-9e9c-4af14ddcac28 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:39.075613 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4dd37b08-ae02-4f3b-9e9c-4af14ddcac28 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:39.086251 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-2ea0ca23-7806-40e0-9e88-aff26d15ed43 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] [instance: 74592942-1569-4db1-bcdb-5f0cf97bea6e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:39.102916 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-2ea0ca23-7806-40e0-9e88-aff26d15ed43 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:39.107855 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-2ea0ca23-7806-40e0-9e88-aff26d15ed43 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:39.113772 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-2ea0ca23-7806-40e0-9e88-aff26d15ed43 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:39.117763 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-2ea0ca23-7806-40e0-9e88-aff26d15ed43 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:39.455521 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-2ea0ca23-7806-40e0-9e88-aff26d15ed43 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbc235b02424200b625af5b9995bbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417f505277c847cf9b6aaf89f1639bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:39.466383 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-2ea0ca23-7806-40e0-9e88-aff26d15ed43 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] 10.222.0.82 "GET /compute/v2.1/servers/74592942-1569-4db1-bcdb-5f0cf97bea6e" status: 200 len: 1319 microversion: 2.1 time: 0.396394 Jan 18 16:32:39.466992 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 178/365] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:39 2022] GET /compute/v2.1/servers/74592942-1569-4db1-bcdb-5f0cf97bea6e => generated 1319 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:39.480503 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [req-b4292ce5-660b-47b7-b7b0-ed8c7216ce81 req-f9e10a69-279d-49bf-a246-33c3140f3f84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1375a98-670c-4cd0-ac9a-3f006da5670c", "name": "network-vif-deleted", "tag": "fbbf13fb-4363-443f-8c0b-3aae0e0a33a7"}]} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:32:39.482149 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:32:39.482149 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: warnings.warn(msg) Jan 18 16:32:39.498210 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-b4292ce5-660b-47b7-b7b0-ed8c7216ce81 req-f9e10a69-279d-49bf-a246-33c3140f3f84 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:39.498664 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-b4292ce5-660b-47b7-b7b0-ed8c7216ce81 req-f9e10a69-279d-49bf-a246-33c3140f3f84 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:39.500144 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-4dd37b08-ae02-4f3b-9e9c-4af14ddcac28 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:39.514111 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-4dd37b08-ae02-4f3b-9e9c-4af14ddcac28 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e" status: 200 len: 1265 microversion: 2.1 time: 0.492649 Jan 18 16:32:39.515676 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.compute.server_external_events [req-b4292ce5-660b-47b7-b7b0-ed8c7216ce81 req-f9e10a69-279d-49bf-a246-33c3140f3f84 service nova] Creating event network-vif-deleted:fbbf13fb-4363-443f-8c0b-3aae0e0a33a7 for instance c1375a98-670c-4cd0-ac9a-3f006da5670c on hv-cinder-78836 Jan 18 16:32:39.516958 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 188/366] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:39 2022] GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e => generated 1265 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:39.533801 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [req-b4292ce5-660b-47b7-b7b0-ed8c7216ce81 req-f9e10a69-279d-49bf-a246-33c3140f3f84 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064852 Jan 18 16:32:39.534916 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 179/367] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:32:39.545544 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-f198dc1d-6fe8-4d3d-82c9-9ea0309936c7 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:39.547654 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-f198dc1d-6fe8-4d3d-82c9-9ea0309936c7 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:39.559716 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-f198dc1d-6fe8-4d3d-82c9-9ea0309936c7 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:39.561328 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-f198dc1d-6fe8-4d3d-82c9-9ea0309936c7 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:39.563593 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-f198dc1d-6fe8-4d3d-82c9-9ea0309936c7 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:39.564948 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-f198dc1d-6fe8-4d3d-82c9-9ea0309936c7 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:39.585719 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-0e64c46f-8716-4474-9858-bc454553c8c5 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:39.586868 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-0e64c46f-8716-4474-9858-bc454553c8c5 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c1375a98-670c-4cd0-ac9a-3f006da5670c] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:39.597915 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0e64c46f-8716-4474-9858-bc454553c8c5 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:39.599818 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0e64c46f-8716-4474-9858-bc454553c8c5 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:39.602793 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0e64c46f-8716-4474-9858-bc454553c8c5 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:39.603500 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0e64c46f-8716-4474-9858-bc454553c8c5 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:39.623457 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.wsgi [None req-0e64c46f-8716-4474-9858-bc454553c8c5 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] HTTP exception thrown: Instance c1375a98-670c-4cd0-ac9a-3f006da5670c could not be found. Jan 18 16:32:39.624390 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-0e64c46f-8716-4474-9858-bc454553c8c5 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Returning 404 to user: Instance c1375a98-670c-4cd0-ac9a-3f006da5670c could not be found. {{(pid=116368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 16:32:39.625534 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-0e64c46f-8716-4474-9858-bc454553c8c5 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "GET /compute/v2.1/servers/c1375a98-670c-4cd0-ac9a-3f006da5670c" status: 404 len: 111 microversion: 2.1 time: 0.047289 Jan 18 16:32:39.626793 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 180/368] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:39 2022] GET /compute/v2.1/servers/c1375a98-670c-4cd0-ac9a-3f006da5670c => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 16:32:39.895785 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-05f886bf-54e1-4605-9b16-5496abd23c37 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1441733163", "imageRef": "900c4a9d-b6c6-451f-a509-eb4f4b49f459", "flavorRef": "452", "networks": [{"uuid": "4a674afc-ab26-4529-b716-118a44373ef3"}]}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:32:39.918627 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-f198dc1d-6fe8-4d3d-82c9-9ea0309936c7 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:39.932641 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-f198dc1d-6fe8-4d3d-82c9-9ea0309936c7 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1566 microversion: 2.1 time: 0.392675 Jan 18 16:32:39.933848 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 189/369] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:39 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1566 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:39.975754 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.network.neutron [None req-05f886bf-54e1-4605-9b16-5496abd23c37 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] validate_networks() for [('4a674afc-ab26-4529-b716-118a44373ef3', None, None, None, None, None)] {{(pid=116368) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 18 16:32:40.037873 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-6f9c8654-9524-4486-8d1b-67e1327dee53 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:40.038943 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-6f9c8654-9524-4486-8d1b-67e1327dee53 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] [instance: 5b22c6de-2dc2-4f6e-99c1-733066ff2fe9] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:40.048530 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6f9c8654-9524-4486-8d1b-67e1327dee53 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:40.050025 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6f9c8654-9524-4486-8d1b-67e1327dee53 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:40.053622 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6f9c8654-9524-4486-8d1b-67e1327dee53 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:40.065062 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6f9c8654-9524-4486-8d1b-67e1327dee53 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:40.780952 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-6f9c8654-9524-4486-8d1b-67e1327dee53 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9b05b022da41bf84f2cdedc94af2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92e3a1c029543f582b45037d145dd04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:40.800256 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-6f9c8654-9524-4486-8d1b-67e1327dee53 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] 10.222.0.82 "GET /compute/v2.1/servers/5b22c6de-2dc2-4f6e-99c1-733066ff2fe9" status: 200 len: 1464 microversion: 2.1 time: 0.761690 Jan 18 16:32:40.806018 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 190/370] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:40 2022] GET /compute/v2.1/servers/5b22c6de-2dc2-4f6e-99c1-733066ff2fe9 => generated 1464 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:40.819761 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-c8ff51e0-4807-4a54-bb42-5d8f035e162f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:40.826264 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-c8ff51e0-4807-4a54-bb42-5d8f035e162f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:40.847955 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c8ff51e0-4807-4a54-bb42-5d8f035e162f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:40.848439 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c8ff51e0-4807-4a54-bb42-5d8f035e162f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:40.857783 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c8ff51e0-4807-4a54-bb42-5d8f035e162f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:40.863782 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c8ff51e0-4807-4a54-bb42-5d8f035e162f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:41.347709 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-05f886bf-54e1-4605-9b16-5496abd23c37 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Flavor limits 0:0:0 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 18 16:32:41.348178 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-05f886bf-54e1-4605-9b16-5496abd23c37 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Image limits 0:0:0 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 18 16:32:41.348598 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-05f886bf-54e1-4605-9b16-5496abd23c37 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Flavor pref 0:0:0 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 18 16:32:41.349828 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-05f886bf-54e1-4605-9b16-5496abd23c37 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Image pref 0:0:0 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 18 16:32:41.350251 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-05f886bf-54e1-4605-9b16-5496abd23c37 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 18 16:32:41.360438 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-c8ff51e0-4807-4a54-bb42-5d8f035e162f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:41.372349 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-c8ff51e0-4807-4a54-bb42-5d8f035e162f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:41.382639 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-05f886bf-54e1-4605-9b16-5496abd23c37 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:41.383093 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-05f886bf-54e1-4605-9b16-5496abd23c37 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:41.383808 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-c8ff51e0-4807-4a54-bb42-5d8f035e162f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:41.387225 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-c8ff51e0-4807-4a54-bb42-5d8f035e162f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1740 microversion: 2.20 time: 0.576549 Jan 18 16:32:41.387849 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 191/371] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:32:40 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1740 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:32:41.399644 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-05f886bf-54e1-4605-9b16-5496abd23c37 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:41.400121 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-05f886bf-54e1-4605-9b16-5496abd23c37 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:41.402349 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-513773de-25c9-429f-a565-ad2c9f4ac83a tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:41.402973 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-513773de-25c9-429f-a565-ad2c9f4ac83a tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] [instance: 74592942-1569-4db1-bcdb-5f0cf97bea6e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:41.442714 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-513773de-25c9-429f-a565-ad2c9f4ac83a tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:41.443776 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-513773de-25c9-429f-a565-ad2c9f4ac83a tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:41.444601 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-513773de-25c9-429f-a565-ad2c9f4ac83a tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:41.445063 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-513773de-25c9-429f-a565-ad2c9f4ac83a tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:41.450173 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.quota [None req-05f886bf-54e1-4605-9b16-5496abd23c37 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Getting quotas for project ad74e7f75a7c41be9e4e3f6884b4d832. Resources: {'ram', 'instances', 'cores'} {{(pid=116368) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 16:32:41.455677 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.quota [None req-05f886bf-54e1-4605-9b16-5496abd23c37 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Getting quotas for user 9424067ecef94af9ae0828b77926f675 and project ad74e7f75a7c41be9e4e3f6884b4d832. Resources: {'ram', 'instances', 'cores'} {{(pid=116368) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 16:32:41.481575 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-05f886bf-54e1-4605-9b16-5496abd23c37 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Going to run 1 instances... {{(pid=116368) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 18 16:32:41.484010 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-05f886bf-54e1-4605-9b16-5496abd23c37 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c2217c82-c31b-4997-a07b-a3f3b15120f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='900c4a9d-b6c6-451f-a509-eb4f4b49f459',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116368) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 18 16:32:41.622581 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-05f886bf-54e1-4605-9b16-5496abd23c37 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.732651 Jan 18 16:32:41.631398 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 181/372] 10.222.0.82 () {60 vars in 1146 bytes} [Tue Jan 18 16:32:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 18 16:32:41.647643 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-7d89d825-5f87-45b3-9dd0-02aa45b1876a tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:41.648641 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-7d89d825-5f87-45b3-9dd0-02aa45b1876a tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: 5b927087-6400-4a41-b19e-0e417905395e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:41.672383 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7d89d825-5f87-45b3-9dd0-02aa45b1876a tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:41.674237 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7d89d825-5f87-45b3-9dd0-02aa45b1876a tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:41.682877 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7d89d825-5f87-45b3-9dd0-02aa45b1876a tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:41.684031 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7d89d825-5f87-45b3-9dd0-02aa45b1876a tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:41.870640 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-513773de-25c9-429f-a565-ad2c9f4ac83a tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbc235b02424200b625af5b9995bbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417f505277c847cf9b6aaf89f1639bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:41.882734 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-513773de-25c9-429f-a565-ad2c9f4ac83a tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] 10.222.0.82 "GET /compute/v2.1/servers/74592942-1569-4db1-bcdb-5f0cf97bea6e" status: 200 len: 1319 microversion: 2.1 time: 0.493799 Jan 18 16:32:41.883321 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 192/373] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:41 2022] GET /compute/v2.1/servers/74592942-1569-4db1-bcdb-5f0cf97bea6e => generated 1319 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:41.899680 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-07f7e65d-8855-468c-bf25-a6e508efb508 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:41.908698 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-07f7e65d-8855-468c-bf25-a6e508efb508 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] [instance: 5b22c6de-2dc2-4f6e-99c1-733066ff2fe9] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:41.931419 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-07f7e65d-8855-468c-bf25-a6e508efb508 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:41.931855 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-07f7e65d-8855-468c-bf25-a6e508efb508 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:41.932660 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-07f7e65d-8855-468c-bf25-a6e508efb508 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:41.933095 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-07f7e65d-8855-468c-bf25-a6e508efb508 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:42.020640 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-07f7e65d-8855-468c-bf25-a6e508efb508 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] [instance: 5b22c6de-2dc2-4f6e-99c1-733066ff2fe9] Going to try to terminate instance {{(pid=116367) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 18 16:32:42.100170 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-7d89d825-5f87-45b3-9dd0-02aa45b1876a tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:42.109577 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-7d89d825-5f87-45b3-9dd0-02aa45b1876a tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e" status: 200 len: 1265 microversion: 2.1 time: 0.475387 Jan 18 16:32:42.128715 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 182/374] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:41 2022] GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e => generated 1265 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:42.142686 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-7fd2efe8-446a-4a38-ba88-1c4a92a69d5f tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:42.143907 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-7fd2efe8-446a-4a38-ba88-1c4a92a69d5f tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:42.157478 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7fd2efe8-446a-4a38-ba88-1c4a92a69d5f tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:42.161648 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7fd2efe8-446a-4a38-ba88-1c4a92a69d5f tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:42.163950 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7fd2efe8-446a-4a38-ba88-1c4a92a69d5f tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:42.165774 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7fd2efe8-446a-4a38-ba88-1c4a92a69d5f tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:42.237699 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-07f7e65d-8855-468c-bf25-a6e508efb508 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] 10.222.0.82 "DELETE /compute/v2.1/servers/5b22c6de-2dc2-4f6e-99c1-733066ff2fe9" status: 204 len: 0 microversion: 2.1 time: 0.352136 Jan 18 16:32:42.238821 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 193/375] 10.222.0.82 () {58 vars in 1238 bytes} [Tue Jan 18 16:32:41 2022] DELETE /compute/v2.1/servers/5b22c6de-2dc2-4f6e-99c1-733066ff2fe9 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 18 16:32:42.253687 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [req-b12dc39c-6012-464b-b73d-e50afa26689a req-bbd09a8a-be83-4329-a601-df1988d735f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74592942-1569-4db1-bcdb-5f0cf97bea6e", "name": "network-vif-plugged", "status": "completed", "tag": "5ab2fdd2-12ac-4769-9cb1-77cabf1c426b"}]} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:32:42.259936 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:32:42.259936 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: warnings.warn(msg) Jan 18 16:32:42.278699 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-b12dc39c-6012-464b-b73d-e50afa26689a req-bbd09a8a-be83-4329-a601-df1988d735f9 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:42.280077 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-b12dc39c-6012-464b-b73d-e50afa26689a req-bbd09a8a-be83-4329-a601-df1988d735f9 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:42.312030 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.compute.server_external_events [req-b12dc39c-6012-464b-b73d-e50afa26689a req-bbd09a8a-be83-4329-a601-df1988d735f9 service nova] Creating event network-vif-plugged:5ab2fdd2-12ac-4769-9cb1-77cabf1c426b for instance 74592942-1569-4db1-bcdb-5f0cf97bea6e on hv-cinder-78836 Jan 18 16:32:42.329562 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [req-b12dc39c-6012-464b-b73d-e50afa26689a req-bbd09a8a-be83-4329-a601-df1988d735f9 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089052 Jan 18 16:32:42.337314 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 194/376] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:32:42.345634 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-3c38fc64-e3d4-4171-8daa-cecdabff45d7 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:42.347627 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-3c38fc64-e3d4-4171-8daa-cecdabff45d7 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c2217c82-c31b-4997-a07b-a3f3b15120f2] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:42.760810 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-3c38fc64-e3d4-4171-8daa-cecdabff45d7 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9424067ecef94af9ae0828b77926f675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74e7f75a7c41be9e4e3f6884b4d832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:42.767333 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-3c38fc64-e3d4-4171-8daa-cecdabff45d7 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2" status: 200 len: 1214 microversion: 2.1 time: 0.428531 Jan 18 16:32:42.768838 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 195/377] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:42 2022] GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2 => generated 1214 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:42.779546 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-3d40ea50-406d-4921-8ef1-2e6093750602 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:42.780217 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-3d40ea50-406d-4921-8ef1-2e6093750602 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] [instance: 5b22c6de-2dc2-4f6e-99c1-733066ff2fe9] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:42.809211 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-3d40ea50-406d-4921-8ef1-2e6093750602 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:42.809856 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-3d40ea50-406d-4921-8ef1-2e6093750602 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:42.815271 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-3d40ea50-406d-4921-8ef1-2e6093750602 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:42.816725 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-3d40ea50-406d-4921-8ef1-2e6093750602 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:42.912389 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-7fd2efe8-446a-4a38-ba88-1c4a92a69d5f tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:42.932157 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-7fd2efe8-446a-4a38-ba88-1c4a92a69d5f tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1566 microversion: 2.1 time: 0.799750 Jan 18 16:32:42.935629 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 183/378] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:42 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1566 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:42.951027 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-3a5796b7-e12f-4890-815a-acbb58358835 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:42.955038 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-3a5796b7-e12f-4890-815a-acbb58358835 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:42.979781 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3a5796b7-e12f-4890-815a-acbb58358835 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:42.980612 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3a5796b7-e12f-4890-815a-acbb58358835 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:42.981667 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3a5796b7-e12f-4890-815a-acbb58358835 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:42.982634 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3a5796b7-e12f-4890-815a-acbb58358835 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:43.406742 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-3d40ea50-406d-4921-8ef1-2e6093750602 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9b05b022da41bf84f2cdedc94af2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92e3a1c029543f582b45037d145dd04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:43.427824 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-3d40ea50-406d-4921-8ef1-2e6093750602 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] 10.222.0.82 "GET /compute/v2.1/servers/5b22c6de-2dc2-4f6e-99c1-733066ff2fe9" status: 200 len: 1470 microversion: 2.1 time: 0.653065 Jan 18 16:32:43.430098 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 196/379] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:42 2022] GET /compute/v2.1/servers/5b22c6de-2dc2-4f6e-99c1-733066ff2fe9 => generated 1470 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:43.452213 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-d7b8a9f3-1d1d-4c26-a731-d5219566e33f tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:43.454279 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-d7b8a9f3-1d1d-4c26-a731-d5219566e33f tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] [instance: 74592942-1569-4db1-bcdb-5f0cf97bea6e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:43.468434 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-3a5796b7-e12f-4890-815a-acbb58358835 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:43.471443 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-d7b8a9f3-1d1d-4c26-a731-d5219566e33f tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:43.473379 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-d7b8a9f3-1d1d-4c26-a731-d5219566e33f tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:43.474297 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-d7b8a9f3-1d1d-4c26-a731-d5219566e33f tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:43.477403 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-d7b8a9f3-1d1d-4c26-a731-d5219566e33f tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:43.478056 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-3a5796b7-e12f-4890-815a-acbb58358835 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:43.479555 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-3a5796b7-e12f-4890-815a-acbb58358835 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:43.480707 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-3a5796b7-e12f-4890-815a-acbb58358835 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1740 microversion: 2.20 time: 0.546180 Jan 18 16:32:43.484667 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 184/380] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:32:42 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1740 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:32:43.513865 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-ca29cb68-218b-4718-b6ee-d7771df40df8 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:43.514494 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-ca29cb68-218b-4718-b6ee-d7771df40df8 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: 5b927087-6400-4a41-b19e-0e417905395e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:43.532577 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ca29cb68-218b-4718-b6ee-d7771df40df8 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:43.534583 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ca29cb68-218b-4718-b6ee-d7771df40df8 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:43.536101 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ca29cb68-218b-4718-b6ee-d7771df40df8 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:43.548422 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ca29cb68-218b-4718-b6ee-d7771df40df8 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:43.829532 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-d7b8a9f3-1d1d-4c26-a731-d5219566e33f tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbc235b02424200b625af5b9995bbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417f505277c847cf9b6aaf89f1639bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:43.844574 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-d7b8a9f3-1d1d-4c26-a731-d5219566e33f tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] 10.222.0.82 "GET /compute/v2.1/servers/74592942-1569-4db1-bcdb-5f0cf97bea6e" status: 200 len: 1319 microversion: 2.1 time: 0.410508 Jan 18 16:32:43.845286 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 197/381] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:43 2022] GET /compute/v2.1/servers/74592942-1569-4db1-bcdb-5f0cf97bea6e => generated 1319 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:43.860424 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-1e801100-5f34-415e-bbbe-d302cf205473 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:43.862208 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-1e801100-5f34-415e-bbbe-d302cf205473 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c2217c82-c31b-4997-a07b-a3f3b15120f2] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:43.869689 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-1e801100-5f34-415e-bbbe-d302cf205473 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:43.870403 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-1e801100-5f34-415e-bbbe-d302cf205473 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:43.871819 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-1e801100-5f34-415e-bbbe-d302cf205473 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:43.872572 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-1e801100-5f34-415e-bbbe-d302cf205473 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:43.987405 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-1e801100-5f34-415e-bbbe-d302cf205473 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9424067ecef94af9ae0828b77926f675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74e7f75a7c41be9e4e3f6884b4d832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:44.001133 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-1e801100-5f34-415e-bbbe-d302cf205473 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2" status: 200 len: 1284 microversion: 2.1 time: 0.145001 Jan 18 16:32:44.012797 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 198/382] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:43 2022] GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2 => generated 1284 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:44.026721 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-efafc90a-15d5-4a14-9220-3e2a762a2031 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:44.030904 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-efafc90a-15d5-4a14-9220-3e2a762a2031 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:44.046010 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-efafc90a-15d5-4a14-9220-3e2a762a2031 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:44.048788 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-efafc90a-15d5-4a14-9220-3e2a762a2031 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:44.052703 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-efafc90a-15d5-4a14-9220-3e2a762a2031 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:44.054963 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-efafc90a-15d5-4a14-9220-3e2a762a2031 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:44.072840 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-ca29cb68-218b-4718-b6ee-d7771df40df8 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:44.095615 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-ca29cb68-218b-4718-b6ee-d7771df40df8 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e" status: 200 len: 1265 microversion: 2.1 time: 0.609337 Jan 18 16:32:44.106416 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 185/383] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:43 2022] GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e => generated 1265 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:44.373857 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-efafc90a-15d5-4a14-9220-3e2a762a2031 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:44.386874 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-efafc90a-15d5-4a14-9220-3e2a762a2031 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1566 microversion: 2.1 time: 0.372860 Jan 18 16:32:44.388740 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 199/384] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:44 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1566 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:44.447332 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-c41279a2-b80a-4c2c-86ec-6a38586b2577 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:44.448318 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-c41279a2-b80a-4c2c-86ec-6a38586b2577 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] [instance: 5b22c6de-2dc2-4f6e-99c1-733066ff2fe9] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:44.460134 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c41279a2-b80a-4c2c-86ec-6a38586b2577 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:44.460587 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c41279a2-b80a-4c2c-86ec-6a38586b2577 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:44.461518 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c41279a2-b80a-4c2c-86ec-6a38586b2577 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:44.461957 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c41279a2-b80a-4c2c-86ec-6a38586b2577 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:44.503592 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-c9107916-1d7d-4d19-9452-ccbc01dd1308 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:44.504220 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-c9107916-1d7d-4d19-9452-ccbc01dd1308 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:44.514618 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c9107916-1d7d-4d19-9452-ccbc01dd1308 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:44.522587 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c9107916-1d7d-4d19-9452-ccbc01dd1308 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:44.524028 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c9107916-1d7d-4d19-9452-ccbc01dd1308 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:44.531696 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c9107916-1d7d-4d19-9452-ccbc01dd1308 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:44.985154 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-c41279a2-b80a-4c2c-86ec-6a38586b2577 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9b05b022da41bf84f2cdedc94af2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92e3a1c029543f582b45037d145dd04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:45.015225 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-c41279a2-b80a-4c2c-86ec-6a38586b2577 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] 10.222.0.82 "GET /compute/v2.1/servers/5b22c6de-2dc2-4f6e-99c1-733066ff2fe9" status: 200 len: 1470 microversion: 2.1 time: 0.572000 Jan 18 16:32:45.017041 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 186/385] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:44 2022] GET /compute/v2.1/servers/5b22c6de-2dc2-4f6e-99c1-733066ff2fe9 => generated 1470 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:45.031631 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-8ece9bd1-b617-46f5-8e57-077785e37735 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:45.032596 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-8ece9bd1-b617-46f5-8e57-077785e37735 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] [instance: 74592942-1569-4db1-bcdb-5f0cf97bea6e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:45.040348 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8ece9bd1-b617-46f5-8e57-077785e37735 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:45.043189 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8ece9bd1-b617-46f5-8e57-077785e37735 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:45.047516 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8ece9bd1-b617-46f5-8e57-077785e37735 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:45.051098 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8ece9bd1-b617-46f5-8e57-077785e37735 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:45.104275 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-c9107916-1d7d-4d19-9452-ccbc01dd1308 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:45.113622 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-c9107916-1d7d-4d19-9452-ccbc01dd1308 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:45.119359 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-c9107916-1d7d-4d19-9452-ccbc01dd1308 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:45.126562 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-c9107916-1d7d-4d19-9452-ccbc01dd1308 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1740 microversion: 2.20 time: 0.627214 Jan 18 16:32:45.127825 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 200/386] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:32:44 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1740 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:32:45.145132 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-89afed66-4e11-49a1-93e3-09c965d3c168 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:45.146124 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-89afed66-4e11-49a1-93e3-09c965d3c168 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c2217c82-c31b-4997-a07b-a3f3b15120f2] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:45.152651 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-89afed66-4e11-49a1-93e3-09c965d3c168 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:45.157361 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-89afed66-4e11-49a1-93e3-09c965d3c168 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:45.168050 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-89afed66-4e11-49a1-93e3-09c965d3c168 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:45.168857 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-89afed66-4e11-49a1-93e3-09c965d3c168 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:45.257010 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-89afed66-4e11-49a1-93e3-09c965d3c168 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9424067ecef94af9ae0828b77926f675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74e7f75a7c41be9e4e3f6884b4d832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:45.265590 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-89afed66-4e11-49a1-93e3-09c965d3c168 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2" status: 200 len: 1272 microversion: 2.1 time: 0.131751 Jan 18 16:32:45.269709 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 201/387] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:45 2022] GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2 => generated 1272 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:45.275662 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-a309cfb3-8612-4f77-80fe-8490dcce9a79 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:45.281915 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-a309cfb3-8612-4f77-80fe-8490dcce9a79 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: 5b927087-6400-4a41-b19e-0e417905395e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:45.302157 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a309cfb3-8612-4f77-80fe-8490dcce9a79 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:45.309114 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a309cfb3-8612-4f77-80fe-8490dcce9a79 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:45.310444 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a309cfb3-8612-4f77-80fe-8490dcce9a79 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:45.310984 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a309cfb3-8612-4f77-80fe-8490dcce9a79 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:45.423412 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-8ece9bd1-b617-46f5-8e57-077785e37735 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbc235b02424200b625af5b9995bbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417f505277c847cf9b6aaf89f1639bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:45.431955 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-8ece9bd1-b617-46f5-8e57-077785e37735 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] 10.222.0.82 "GET /compute/v2.1/servers/74592942-1569-4db1-bcdb-5f0cf97bea6e" status: 200 len: 1507 microversion: 2.1 time: 0.413102 Jan 18 16:32:45.434888 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 187/388] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:45 2022] GET /compute/v2.1/servers/74592942-1569-4db1-bcdb-5f0cf97bea6e => generated 1507 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:45.448111 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-264ad425-8197-4966-bd14-89724687d401 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:45.448440 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-264ad425-8197-4966-bd14-89724687d401 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:45.470073 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-264ad425-8197-4966-bd14-89724687d401 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:45.471342 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-264ad425-8197-4966-bd14-89724687d401 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:45.475802 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-264ad425-8197-4966-bd14-89724687d401 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:45.476299 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-264ad425-8197-4966-bd14-89724687d401 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:45.643444 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-a309cfb3-8612-4f77-80fe-8490dcce9a79 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:45.654482 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-a309cfb3-8612-4f77-80fe-8490dcce9a79 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e" status: 200 len: 1265 microversion: 2.1 time: 0.381515 Jan 18 16:32:45.658815 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 202/389] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:45 2022] GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e => generated 1265 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:45.770376 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-264ad425-8197-4966-bd14-89724687d401 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:45.782718 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-264ad425-8197-4966-bd14-89724687d401 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1566 microversion: 2.1 time: 0.344907 Jan 18 16:32:45.784434 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 188/390] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:45 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1566 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:46.037378 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-1106ca96-77b9-4383-bf1a-94affe069678 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:46.037990 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-1106ca96-77b9-4383-bf1a-94affe069678 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] [instance: 5b22c6de-2dc2-4f6e-99c1-733066ff2fe9] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:46.050093 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-1106ca96-77b9-4383-bf1a-94affe069678 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:46.050888 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-1106ca96-77b9-4383-bf1a-94affe069678 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:46.053843 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-1106ca96-77b9-4383-bf1a-94affe069678 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:46.055234 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-1106ca96-77b9-4383-bf1a-94affe069678 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:46.152243 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-b20065b4-47de-432d-bef0-b2a251bea6c5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:46.152855 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-b20065b4-47de-432d-bef0-b2a251bea6c5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:46.237776 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-b20065b4-47de-432d-bef0-b2a251bea6c5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:46.242480 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-b20065b4-47de-432d-bef0-b2a251bea6c5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:46.243716 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-b20065b4-47de-432d-bef0-b2a251bea6c5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:46.244312 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-b20065b4-47de-432d-bef0-b2a251bea6c5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:46.576798 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-1106ca96-77b9-4383-bf1a-94affe069678 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9b05b022da41bf84f2cdedc94af2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92e3a1c029543f582b45037d145dd04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:46.586617 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-1106ca96-77b9-4383-bf1a-94affe069678 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] 10.222.0.82 "GET /compute/v2.1/servers/5b22c6de-2dc2-4f6e-99c1-733066ff2fe9" status: 200 len: 1470 microversion: 2.1 time: 0.553320 Jan 18 16:32:46.593661 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 203/391] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:46 2022] GET /compute/v2.1/servers/5b22c6de-2dc2-4f6e-99c1-733066ff2fe9 => generated 1470 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:46.604796 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-7b5809b9-a7df-4e98-a581-991057f12190 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:46.612987 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-7b5809b9-a7df-4e98-a581-991057f12190 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c2217c82-c31b-4997-a07b-a3f3b15120f2] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:46.627677 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7b5809b9-a7df-4e98-a581-991057f12190 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:46.634288 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7b5809b9-a7df-4e98-a581-991057f12190 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:46.635956 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7b5809b9-a7df-4e98-a581-991057f12190 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:46.638910 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7b5809b9-a7df-4e98-a581-991057f12190 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:46.792011 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-7b5809b9-a7df-4e98-a581-991057f12190 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9424067ecef94af9ae0828b77926f675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74e7f75a7c41be9e4e3f6884b4d832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:46.805301 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-7b5809b9-a7df-4e98-a581-991057f12190 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2" status: 200 len: 1272 microversion: 2.1 time: 0.210268 Jan 18 16:32:46.806431 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 204/392] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:46 2022] GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2 => generated 1272 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:46.808521 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-b20065b4-47de-432d-bef0-b2a251bea6c5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:46.817364 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-b20065b4-47de-432d-bef0-b2a251bea6c5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:46.818978 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-b20065b4-47de-432d-bef0-b2a251bea6c5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:46.819248 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-df987dfc-918f-47e5-bdb6-b24247a2348e tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:46.820292 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-b20065b4-47de-432d-bef0-b2a251bea6c5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1740 microversion: 2.20 time: 0.679101 Jan 18 16:32:46.822222 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-df987dfc-918f-47e5-bdb6-b24247a2348e tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: 5b927087-6400-4a41-b19e-0e417905395e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:46.830497 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 189/393] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:32:46 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1740 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 16:32:46.832937 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-df987dfc-918f-47e5-bdb6-b24247a2348e tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:46.833597 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-df987dfc-918f-47e5-bdb6-b24247a2348e tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:46.834744 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-df987dfc-918f-47e5-bdb6-b24247a2348e tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:46.836510 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-df987dfc-918f-47e5-bdb6-b24247a2348e tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:46.847427 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-1eaa4d54-0e15-4990-a82a-036ee2768215 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:46.851549 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-1eaa4d54-0e15-4990-a82a-036ee2768215 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:46.863333 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1eaa4d54-0e15-4990-a82a-036ee2768215 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:46.865425 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1eaa4d54-0e15-4990-a82a-036ee2768215 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:46.868903 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1eaa4d54-0e15-4990-a82a-036ee2768215 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:46.869568 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1eaa4d54-0e15-4990-a82a-036ee2768215 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:47.202426 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-df987dfc-918f-47e5-bdb6-b24247a2348e tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:47.244987 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-df987dfc-918f-47e5-bdb6-b24247a2348e tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e" status: 200 len: 1265 microversion: 2.1 time: 0.436448 Jan 18 16:32:47.260809 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 205/394] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:46 2022] GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e => generated 1265 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:47.292520 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-1eaa4d54-0e15-4990-a82a-036ee2768215 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:47.304252 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-1eaa4d54-0e15-4990-a82a-036ee2768215 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1566 microversion: 2.1 time: 0.472254 Jan 18 16:32:47.305454 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 190/395] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:46 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1566 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:47.453214 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [req-03519748-f32c-4a03-ae75-568bbb9ea22a req-ab0e1ab4-569a-4287-8ba1-c09bfcb9add2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b22c6de-2dc2-4f6e-99c1-733066ff2fe9", "name": "network-vif-deleted", "tag": "d6be0e64-7cfa-4b6c-9ce0-2103385f693f"}]} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:32:47.457141 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:32:47.457141 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: warnings.warn(msg) Jan 18 16:32:47.484732 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-03519748-f32c-4a03-ae75-568bbb9ea22a req-ab0e1ab4-569a-4287-8ba1-c09bfcb9add2 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:47.487503 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-03519748-f32c-4a03-ae75-568bbb9ea22a req-ab0e1ab4-569a-4287-8ba1-c09bfcb9add2 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:47.507750 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.compute.server_external_events [req-03519748-f32c-4a03-ae75-568bbb9ea22a req-ab0e1ab4-569a-4287-8ba1-c09bfcb9add2 service nova] Creating event network-vif-deleted:d6be0e64-7cfa-4b6c-9ce0-2103385f693f for instance 5b22c6de-2dc2-4f6e-99c1-733066ff2fe9 on hv-cinder-78836 Jan 18 16:32:47.528703 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [req-03519748-f32c-4a03-ae75-568bbb9ea22a req-ab0e1ab4-569a-4287-8ba1-c09bfcb9add2 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083665 Jan 18 16:32:47.530293 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 206/396] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:32:47.613049 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-cde560c5-9719-4ba0-90fb-04ddf26728ba tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:47.614058 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-cde560c5-9719-4ba0-90fb-04ddf26728ba tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] [instance: 5b22c6de-2dc2-4f6e-99c1-733066ff2fe9] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:47.624536 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-cde560c5-9719-4ba0-90fb-04ddf26728ba tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:47.627971 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-cde560c5-9719-4ba0-90fb-04ddf26728ba tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:47.628833 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-cde560c5-9719-4ba0-90fb-04ddf26728ba tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:47.631497 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-cde560c5-9719-4ba0-90fb-04ddf26728ba tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:47.718169 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-cde560c5-9719-4ba0-90fb-04ddf26728ba tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9b05b022da41bf84f2cdedc94af2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92e3a1c029543f582b45037d145dd04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:47.741934 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-cde560c5-9719-4ba0-90fb-04ddf26728ba tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] 10.222.0.82 "GET /compute/v2.1/servers/5b22c6de-2dc2-4f6e-99c1-733066ff2fe9" status: 200 len: 1428 microversion: 2.1 time: 0.133850 Jan 18 16:32:47.748963 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 191/397] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:47 2022] GET /compute/v2.1/servers/5b22c6de-2dc2-4f6e-99c1-733066ff2fe9 => generated 1428 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:47.836859 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-cc442495-96b0-4532-ba33-faaf04f5398b tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:47.837578 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-cc442495-96b0-4532-ba33-faaf04f5398b tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c2217c82-c31b-4997-a07b-a3f3b15120f2] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:47.856424 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-cc442495-96b0-4532-ba33-faaf04f5398b tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:47.858896 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-cc442495-96b0-4532-ba33-faaf04f5398b tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:47.862080 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-cc442495-96b0-4532-ba33-faaf04f5398b tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:47.862537 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-cc442495-96b0-4532-ba33-faaf04f5398b tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:47.875711 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-b74f8b20-9404-4c6d-86f2-0e87bbbb00ed tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:47.878551 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-b74f8b20-9404-4c6d-86f2-0e87bbbb00ed tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:47.891725 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-b74f8b20-9404-4c6d-86f2-0e87bbbb00ed tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:47.896504 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-b74f8b20-9404-4c6d-86f2-0e87bbbb00ed tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:47.899969 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-b74f8b20-9404-4c6d-86f2-0e87bbbb00ed tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:47.900421 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-b74f8b20-9404-4c6d-86f2-0e87bbbb00ed tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:48.243761 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-cc442495-96b0-4532-ba33-faaf04f5398b tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9424067ecef94af9ae0828b77926f675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74e7f75a7c41be9e4e3f6884b4d832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:48.271140 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-cc442495-96b0-4532-ba33-faaf04f5398b tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2" status: 200 len: 1314 microversion: 2.1 time: 0.427312 Jan 18 16:32:48.280998 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 207/398] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:47 2022] GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2 => generated 1314 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:48.300386 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-9866e857-6869-4a7b-b3df-9011e580b32a tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:48.301085 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-9866e857-6869-4a7b-b3df-9011e580b32a tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: 5b927087-6400-4a41-b19e-0e417905395e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:48.340615 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-9866e857-6869-4a7b-b3df-9011e580b32a tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:48.341342 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-9866e857-6869-4a7b-b3df-9011e580b32a tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:48.342537 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-9866e857-6869-4a7b-b3df-9011e580b32a tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:48.343344 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-9866e857-6869-4a7b-b3df-9011e580b32a tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:48.376458 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-b74f8b20-9404-4c6d-86f2-0e87bbbb00ed tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:48.406028 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-b74f8b20-9404-4c6d-86f2-0e87bbbb00ed tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:48.411642 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-b74f8b20-9404-4c6d-86f2-0e87bbbb00ed tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:48.413232 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-b74f8b20-9404-4c6d-86f2-0e87bbbb00ed tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1740 microversion: 2.20 time: 0.568686 Jan 18 16:32:48.416361 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 192/399] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:32:47 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1740 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:32:48.427824 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-5ce9b082-1a8b-4c1a-93a5-93c8df1e1622 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:48.429909 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-5ce9b082-1a8b-4c1a-93a5-93c8df1e1622 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:48.449761 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-5ce9b082-1a8b-4c1a-93a5-93c8df1e1622 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:48.450484 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-5ce9b082-1a8b-4c1a-93a5-93c8df1e1622 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:48.451483 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-5ce9b082-1a8b-4c1a-93a5-93c8df1e1622 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:48.452748 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-5ce9b082-1a8b-4c1a-93a5-93c8df1e1622 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:48.633440 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-9866e857-6869-4a7b-b3df-9011e580b32a tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:48.643667 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-9866e857-6869-4a7b-b3df-9011e580b32a tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e" status: 200 len: 1265 microversion: 2.1 time: 0.359509 Jan 18 16:32:48.649108 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 208/400] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:48 2022] GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e => generated 1265 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:48.763202 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-795597c6-19a3-489a-a3f7-268931cb2994 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:48.764109 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-795597c6-19a3-489a-a3f7-268931cb2994 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] [instance: 5b22c6de-2dc2-4f6e-99c1-733066ff2fe9] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:48.779556 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-795597c6-19a3-489a-a3f7-268931cb2994 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:48.780534 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-795597c6-19a3-489a-a3f7-268931cb2994 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:48.781488 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-795597c6-19a3-489a-a3f7-268931cb2994 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:48.781578 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-5ce9b082-1a8b-4c1a-93a5-93c8df1e1622 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:48.781857 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-795597c6-19a3-489a-a3f7-268931cb2994 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:48.797745 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-5ce9b082-1a8b-4c1a-93a5-93c8df1e1622 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1566 microversion: 2.1 time: 0.379848 Jan 18 16:32:48.799059 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 193/401] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:48 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1566 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:48.808116 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.wsgi [None req-795597c6-19a3-489a-a3f7-268931cb2994 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] HTTP exception thrown: Instance 5b22c6de-2dc2-4f6e-99c1-733066ff2fe9 could not be found. Jan 18 16:32:48.809255 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-795597c6-19a3-489a-a3f7-268931cb2994 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] Returning 404 to user: Instance 5b22c6de-2dc2-4f6e-99c1-733066ff2fe9 could not be found. {{(pid=116367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 16:32:48.810362 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-795597c6-19a3-489a-a3f7-268931cb2994 tempest-VolumesNegativeTest-636342578 tempest-VolumesNegativeTest-636342578-project] 10.222.0.82 "GET /compute/v2.1/servers/5b22c6de-2dc2-4f6e-99c1-733066ff2fe9" status: 404 len: 111 microversion: 2.1 time: 0.052379 Jan 18 16:32:48.811024 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 209/402] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:48 2022] GET /compute/v2.1/servers/5b22c6de-2dc2-4f6e-99c1-733066ff2fe9 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 18 16:32:49.288996 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-91088cf5-50c6-41f7-9b28-26a2c17c174a tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:49.289708 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-91088cf5-50c6-41f7-9b28-26a2c17c174a tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c2217c82-c31b-4997-a07b-a3f3b15120f2] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:49.304856 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-91088cf5-50c6-41f7-9b28-26a2c17c174a tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:49.305671 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-91088cf5-50c6-41f7-9b28-26a2c17c174a tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:49.306476 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-91088cf5-50c6-41f7-9b28-26a2c17c174a tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:49.306908 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-91088cf5-50c6-41f7-9b28-26a2c17c174a tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:49.435622 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-d13483ed-8fc0-42d7-9d8e-9e8d1003f2f3 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:49.436566 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-d13483ed-8fc0-42d7-9d8e-9e8d1003f2f3 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:49.460398 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-d13483ed-8fc0-42d7-9d8e-9e8d1003f2f3 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:49.461165 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-d13483ed-8fc0-42d7-9d8e-9e8d1003f2f3 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:49.464529 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-d13483ed-8fc0-42d7-9d8e-9e8d1003f2f3 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:49.464846 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-d13483ed-8fc0-42d7-9d8e-9e8d1003f2f3 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:49.603352 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-91088cf5-50c6-41f7-9b28-26a2c17c174a tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9424067ecef94af9ae0828b77926f675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74e7f75a7c41be9e4e3f6884b4d832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:49.612165 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-91088cf5-50c6-41f7-9b28-26a2c17c174a tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2" status: 200 len: 1314 microversion: 2.1 time: 0.327133 Jan 18 16:32:49.613452 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 194/403] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:49 2022] GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2 => generated 1314 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:32:49.620680 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [req-312f2851-79c5-49bb-be08-1074a1d19cfb req-9b47de61-5bb6-465e-a5cc-91d3c793c00d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2217c82-c31b-4997-a07b-a3f3b15120f2", "tag": "b39ad36c-c85b-4774-a7c4-2ec833039594"}]} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:32:49.622713 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:32:49.622713 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: warnings.warn(msg) Jan 18 16:32:49.630984 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-312f2851-79c5-49bb-be08-1074a1d19cfb req-9b47de61-5bb6-465e-a5cc-91d3c793c00d service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:49.631497 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-312f2851-79c5-49bb-be08-1074a1d19cfb req-9b47de61-5bb6-465e-a5cc-91d3c793c00d service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:49.642967 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.compute.server_external_events [req-312f2851-79c5-49bb-be08-1074a1d19cfb req-9b47de61-5bb6-465e-a5cc-91d3c793c00d service nova] Creating event network-changed:b39ad36c-c85b-4774-a7c4-2ec833039594 for instance c2217c82-c31b-4997-a07b-a3f3b15120f2 on hv-cinder-78836 Jan 18 16:32:49.650136 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [req-312f2851-79c5-49bb-be08-1074a1d19cfb req-9b47de61-5bb6-465e-a5cc-91d3c793c00d service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034746 Jan 18 16:32:49.651722 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 195/404] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:32:49.666050 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-27d6e3d9-b4da-4224-a490-fede4186e864 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:49.667019 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-27d6e3d9-b4da-4224-a490-fede4186e864 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: 5b927087-6400-4a41-b19e-0e417905395e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:49.675526 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-27d6e3d9-b4da-4224-a490-fede4186e864 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:49.676264 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-27d6e3d9-b4da-4224-a490-fede4186e864 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:49.677294 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-27d6e3d9-b4da-4224-a490-fede4186e864 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:49.677908 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-27d6e3d9-b4da-4224-a490-fede4186e864 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:49.762161 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-d13483ed-8fc0-42d7-9d8e-9e8d1003f2f3 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:49.773581 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-d13483ed-8fc0-42d7-9d8e-9e8d1003f2f3 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:49.776489 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-d13483ed-8fc0-42d7-9d8e-9e8d1003f2f3 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:49.777868 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-d13483ed-8fc0-42d7-9d8e-9e8d1003f2f3 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1722 microversion: 2.20 time: 0.346162 Jan 18 16:32:49.778922 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 210/405] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:32:49 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1722 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:32:49.816531 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-399a0054-5f58-4538-a932-f9c6ffb76090 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:49.817560 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-399a0054-5f58-4538-a932-f9c6ffb76090 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:49.823725 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-399a0054-5f58-4538-a932-f9c6ffb76090 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:49.824489 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-399a0054-5f58-4538-a932-f9c6ffb76090 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:49.825542 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-399a0054-5f58-4538-a932-f9c6ffb76090 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:49.826208 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-399a0054-5f58-4538-a932-f9c6ffb76090 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:49.922471 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-27d6e3d9-b4da-4224-a490-fede4186e864 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:49.933501 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-27d6e3d9-b4da-4224-a490-fede4186e864 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e" status: 200 len: 1265 microversion: 2.1 time: 0.272146 Jan 18 16:32:49.947006 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 196/406] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:49 2022] GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e => generated 1265 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:32:50.012103 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-399a0054-5f58-4538-a932-f9c6ffb76090 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:50.020507 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-399a0054-5f58-4538-a932-f9c6ffb76090 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1566 microversion: 2.1 time: 0.208484 Jan 18 16:32:50.030236 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 211/407] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:49 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1566 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:32:50.630806 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-a9af9566-5c72-4aac-a0d7-2f1fa3ee2404 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:50.632395 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-a9af9566-5c72-4aac-a0d7-2f1fa3ee2404 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c2217c82-c31b-4997-a07b-a3f3b15120f2] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:50.639314 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a9af9566-5c72-4aac-a0d7-2f1fa3ee2404 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:50.639907 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a9af9566-5c72-4aac-a0d7-2f1fa3ee2404 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:50.640797 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a9af9566-5c72-4aac-a0d7-2f1fa3ee2404 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:50.641357 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a9af9566-5c72-4aac-a0d7-2f1fa3ee2404 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:50.798171 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-9b612cdf-dc1e-410a-a222-a1356b5c0b7e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:50.799301 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-9b612cdf-dc1e-410a-a222-a1356b5c0b7e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:50.814668 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-9b612cdf-dc1e-410a-a222-a1356b5c0b7e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:50.823727 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-9b612cdf-dc1e-410a-a222-a1356b5c0b7e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:50.824729 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-9b612cdf-dc1e-410a-a222-a1356b5c0b7e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:50.827568 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-9b612cdf-dc1e-410a-a222-a1356b5c0b7e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:50.903183 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-a9af9566-5c72-4aac-a0d7-2f1fa3ee2404 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9424067ecef94af9ae0828b77926f675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74e7f75a7c41be9e4e3f6884b4d832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:50.913105 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-a9af9566-5c72-4aac-a0d7-2f1fa3ee2404 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2" status: 200 len: 1314 microversion: 2.1 time: 0.287085 Jan 18 16:32:50.923478 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 197/408] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:50 2022] GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2 => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:50.951359 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-0e4821ba-3d89-4584-bb77-f1e0527e155d tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:50.959298 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-0e4821ba-3d89-4584-bb77-f1e0527e155d tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: 5b927087-6400-4a41-b19e-0e417905395e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:50.968693 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0e4821ba-3d89-4584-bb77-f1e0527e155d tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:50.969671 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0e4821ba-3d89-4584-bb77-f1e0527e155d tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:50.970520 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0e4821ba-3d89-4584-bb77-f1e0527e155d tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:50.972302 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0e4821ba-3d89-4584-bb77-f1e0527e155d tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:51.128278 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-9b612cdf-dc1e-410a-a222-a1356b5c0b7e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:51.139036 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-9b612cdf-dc1e-410a-a222-a1356b5c0b7e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:51.141246 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-9b612cdf-dc1e-410a-a222-a1356b5c0b7e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:51.142934 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-9b612cdf-dc1e-410a-a222-a1356b5c0b7e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1722 microversion: 2.20 time: 0.349255 Jan 18 16:32:51.144131 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 212/409] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:32:50 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1722 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:32:51.148799 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-7d3803fb-a170-4e4b-a495-382322ff8c22 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:51.152436 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-7d3803fb-a170-4e4b-a495-382322ff8c22 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:51.163626 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7d3803fb-a170-4e4b-a495-382322ff8c22 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:51.164337 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7d3803fb-a170-4e4b-a495-382322ff8c22 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:51.165517 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7d3803fb-a170-4e4b-a495-382322ff8c22 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:51.166892 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7d3803fb-a170-4e4b-a495-382322ff8c22 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:51.309247 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-0e4821ba-3d89-4584-bb77-f1e0527e155d tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:51.324273 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-0e4821ba-3d89-4584-bb77-f1e0527e155d tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e" status: 200 len: 1265 microversion: 2.1 time: 0.376407 Jan 18 16:32:51.326802 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 198/410] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:50 2022] GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e => generated 1265 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:32:51.416420 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-7d3803fb-a170-4e4b-a495-382322ff8c22 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:51.425322 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-7d3803fb-a170-4e4b-a495-382322ff8c22 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1566 microversion: 2.1 time: 0.279613 Jan 18 16:32:51.425869 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 213/411] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:51 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1566 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:51.932717 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-9d1effef-4c02-4835-bf67-a958d9e69d65 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:51.934706 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-9d1effef-4c02-4835-bf67-a958d9e69d65 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c2217c82-c31b-4997-a07b-a3f3b15120f2] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:51.949533 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-9d1effef-4c02-4835-bf67-a958d9e69d65 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:51.960779 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-9d1effef-4c02-4835-bf67-a958d9e69d65 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:51.962592 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-9d1effef-4c02-4835-bf67-a958d9e69d65 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:51.966199 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-9d1effef-4c02-4835-bf67-a958d9e69d65 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:52.165695 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-7154a4ba-a12b-42f2-a0a2-9ff945dc19ec tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:52.166481 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-7154a4ba-a12b-42f2-a0a2-9ff945dc19ec tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:52.185121 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7154a4ba-a12b-42f2-a0a2-9ff945dc19ec tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:52.185121 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7154a4ba-a12b-42f2-a0a2-9ff945dc19ec tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:52.185121 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7154a4ba-a12b-42f2-a0a2-9ff945dc19ec tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:52.185121 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7154a4ba-a12b-42f2-a0a2-9ff945dc19ec tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:52.276703 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-9d1effef-4c02-4835-bf67-a958d9e69d65 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9424067ecef94af9ae0828b77926f675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74e7f75a7c41be9e4e3f6884b4d832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:52.291592 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-9d1effef-4c02-4835-bf67-a958d9e69d65 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2" status: 200 len: 1314 microversion: 2.1 time: 0.364706 Jan 18 16:32:52.293865 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 199/412] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:51 2022] GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2 => generated 1314 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:52.343232 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-c06c85e6-3404-4ab4-aa88-fb3ac71c1ebf tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:52.344190 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-c06c85e6-3404-4ab4-aa88-fb3ac71c1ebf tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: 5b927087-6400-4a41-b19e-0e417905395e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:52.354320 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c06c85e6-3404-4ab4-aa88-fb3ac71c1ebf tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:52.355101 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c06c85e6-3404-4ab4-aa88-fb3ac71c1ebf tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:52.356079 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c06c85e6-3404-4ab4-aa88-fb3ac71c1ebf tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:52.356792 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c06c85e6-3404-4ab4-aa88-fb3ac71c1ebf tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:52.600894 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-7154a4ba-a12b-42f2-a0a2-9ff945dc19ec tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:52.619388 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-7154a4ba-a12b-42f2-a0a2-9ff945dc19ec tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:52.620884 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-7154a4ba-a12b-42f2-a0a2-9ff945dc19ec tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:52.622077 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-7154a4ba-a12b-42f2-a0a2-9ff945dc19ec tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1722 microversion: 2.20 time: 0.464019 Jan 18 16:32:52.623377 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 214/413] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:32:52 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1722 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:32:52.634062 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-f3cdce84-5fba-4438-96df-6543b0bb9870 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:52.634938 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-f3cdce84-5fba-4438-96df-6543b0bb9870 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:52.642109 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-f3cdce84-5fba-4438-96df-6543b0bb9870 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:52.643371 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-f3cdce84-5fba-4438-96df-6543b0bb9870 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:52.644333 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-f3cdce84-5fba-4438-96df-6543b0bb9870 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:52.644943 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-f3cdce84-5fba-4438-96df-6543b0bb9870 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:52.703097 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-c06c85e6-3404-4ab4-aa88-fb3ac71c1ebf tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:52.713152 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-c06c85e6-3404-4ab4-aa88-fb3ac71c1ebf tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e" status: 200 len: 1265 microversion: 2.1 time: 0.373356 Jan 18 16:32:52.719451 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 200/414] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:52 2022] GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e => generated 1265 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:32:52.953450 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-f3cdce84-5fba-4438-96df-6543b0bb9870 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:52.965987 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-f3cdce84-5fba-4438-96df-6543b0bb9870 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1566 microversion: 2.1 time: 0.340006 Jan 18 16:32:52.981915 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 215/415] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:52 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1566 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:53.311103 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-9d966fc2-da48-48d2-9929-acada864c5d1 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:53.314044 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-9d966fc2-da48-48d2-9929-acada864c5d1 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c2217c82-c31b-4997-a07b-a3f3b15120f2] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:53.320846 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-9d966fc2-da48-48d2-9929-acada864c5d1 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:53.321310 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-9d966fc2-da48-48d2-9929-acada864c5d1 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:53.322092 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-9d966fc2-da48-48d2-9929-acada864c5d1 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:53.322516 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-9d966fc2-da48-48d2-9929-acada864c5d1 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:53.469744 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-9d966fc2-da48-48d2-9929-acada864c5d1 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9424067ecef94af9ae0828b77926f675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74e7f75a7c41be9e4e3f6884b4d832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:53.479811 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-9d966fc2-da48-48d2-9929-acada864c5d1 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2" status: 200 len: 1314 microversion: 2.1 time: 0.172642 Jan 18 16:32:53.480532 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 201/416] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:53 2022] GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:53.641201 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-31faa1ce-3b92-4db3-94a3-9e1ace57247c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:53.642513 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-31faa1ce-3b92-4db3-94a3-9e1ace57247c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:53.650561 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-31faa1ce-3b92-4db3-94a3-9e1ace57247c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:53.651388 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-31faa1ce-3b92-4db3-94a3-9e1ace57247c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:53.652258 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-31faa1ce-3b92-4db3-94a3-9e1ace57247c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:53.652687 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-31faa1ce-3b92-4db3-94a3-9e1ace57247c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:53.732960 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-9a392888-fbab-44fd-95e5-64c4df702e82 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:53.733836 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-9a392888-fbab-44fd-95e5-64c4df702e82 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: 5b927087-6400-4a41-b19e-0e417905395e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:53.740500 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-9a392888-fbab-44fd-95e5-64c4df702e82 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:53.740973 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-9a392888-fbab-44fd-95e5-64c4df702e82 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:53.741962 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-9a392888-fbab-44fd-95e5-64c4df702e82 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:53.742555 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-9a392888-fbab-44fd-95e5-64c4df702e82 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:53.853209 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-31faa1ce-3b92-4db3-94a3-9e1ace57247c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:53.862655 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-31faa1ce-3b92-4db3-94a3-9e1ace57247c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:53.864188 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-31faa1ce-3b92-4db3-94a3-9e1ace57247c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:53.865406 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-31faa1ce-3b92-4db3-94a3-9e1ace57247c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1722 microversion: 2.20 time: 0.228069 Jan 18 16:32:53.865971 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 216/417] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:32:53 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:32:53.940021 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-9a392888-fbab-44fd-95e5-64c4df702e82 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:53.952657 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-9a392888-fbab-44fd-95e5-64c4df702e82 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e" status: 200 len: 1265 microversion: 2.1 time: 0.223102 Jan 18 16:32:53.980152 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 202/418] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:53 2022] GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e => generated 1265 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:53.993018 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-af886efc-1e42-4341-8b33-f364672ea1fa tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:53.993018 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-af886efc-1e42-4341-8b33-f364672ea1fa tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:54.004144 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-af886efc-1e42-4341-8b33-f364672ea1fa tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:54.004866 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-af886efc-1e42-4341-8b33-f364672ea1fa tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:54.010617 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-af886efc-1e42-4341-8b33-f364672ea1fa tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:54.013329 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-af886efc-1e42-4341-8b33-f364672ea1fa tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:54.181499 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-af886efc-1e42-4341-8b33-f364672ea1fa tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:54.190996 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-af886efc-1e42-4341-8b33-f364672ea1fa tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1566 microversion: 2.1 time: 0.206535 Jan 18 16:32:54.191675 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 217/419] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:53 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1566 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:32:54.497321 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-8de577d8-ec69-40fc-9f86-1ecddf6b7f80 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:54.498575 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-8de577d8-ec69-40fc-9f86-1ecddf6b7f80 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c2217c82-c31b-4997-a07b-a3f3b15120f2] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:54.505549 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8de577d8-ec69-40fc-9f86-1ecddf6b7f80 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:54.505988 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8de577d8-ec69-40fc-9f86-1ecddf6b7f80 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:54.506767 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8de577d8-ec69-40fc-9f86-1ecddf6b7f80 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:54.507190 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8de577d8-ec69-40fc-9f86-1ecddf6b7f80 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:54.658720 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-8de577d8-ec69-40fc-9f86-1ecddf6b7f80 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9424067ecef94af9ae0828b77926f675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74e7f75a7c41be9e4e3f6884b4d832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:54.666386 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-8de577d8-ec69-40fc-9f86-1ecddf6b7f80 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2" status: 200 len: 1314 microversion: 2.1 time: 0.172619 Jan 18 16:32:54.666964 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 203/420] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:54 2022] GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:54.883866 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-227b6a4a-1c26-477f-82b3-6c26d26c2799 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:54.884512 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-227b6a4a-1c26-477f-82b3-6c26d26c2799 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:54.890836 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-227b6a4a-1c26-477f-82b3-6c26d26c2799 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:54.893683 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-227b6a4a-1c26-477f-82b3-6c26d26c2799 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:54.894634 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-227b6a4a-1c26-477f-82b3-6c26d26c2799 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:54.895162 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-227b6a4a-1c26-477f-82b3-6c26d26c2799 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:54.977516 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-eb42a0ae-6ff9-461f-987b-d49509202538 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:54.978241 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-eb42a0ae-6ff9-461f-987b-d49509202538 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: 5b927087-6400-4a41-b19e-0e417905395e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:54.987032 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-eb42a0ae-6ff9-461f-987b-d49509202538 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:54.988993 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-eb42a0ae-6ff9-461f-987b-d49509202538 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:54.990206 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-eb42a0ae-6ff9-461f-987b-d49509202538 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:54.990644 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-eb42a0ae-6ff9-461f-987b-d49509202538 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:55.101847 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-227b6a4a-1c26-477f-82b3-6c26d26c2799 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:55.112450 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-227b6a4a-1c26-477f-82b3-6c26d26c2799 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:55.114265 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-227b6a4a-1c26-477f-82b3-6c26d26c2799 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:55.115421 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-227b6a4a-1c26-477f-82b3-6c26d26c2799 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1722 microversion: 2.20 time: 0.235695 Jan 18 16:32:55.115974 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 218/421] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:32:54 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 16:32:55.208238 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-cfac02ca-c25b-471d-8e98-d79cb6aa373e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:55.208849 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-cfac02ca-c25b-471d-8e98-d79cb6aa373e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:55.214873 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-cfac02ca-c25b-471d-8e98-d79cb6aa373e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:55.215315 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-cfac02ca-c25b-471d-8e98-d79cb6aa373e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:55.216397 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-cfac02ca-c25b-471d-8e98-d79cb6aa373e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:55.216839 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-cfac02ca-c25b-471d-8e98-d79cb6aa373e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:55.224011 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-eb42a0ae-6ff9-461f-987b-d49509202538 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:55.233468 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-eb42a0ae-6ff9-461f-987b-d49509202538 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e" status: 200 len: 1265 microversion: 2.1 time: 0.259454 Jan 18 16:32:55.245336 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 204/422] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:54 2022] GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e => generated 1265 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:32:55.387492 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-cfac02ca-c25b-471d-8e98-d79cb6aa373e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:55.395367 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-cfac02ca-c25b-471d-8e98-d79cb6aa373e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1566 microversion: 2.1 time: 0.191594 Jan 18 16:32:55.405742 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 219/423] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:55 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1566 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:32:55.665011 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [req-89852364-bd41-4315-9538-7deb9eb0d6a9 req-0e41e02f-3f5d-4a8a-971d-2d4a1ee19a72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b927087-6400-4a41-b19e-0e417905395e", "name": "network-vif-plugged", "status": "completed", "tag": "0e5fd19d-7b69-41f6-849c-97ce9658dc29"}]} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:32:55.669698 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:32:55.669698 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: warnings.warn(msg) Jan 18 16:32:55.680228 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-89852364-bd41-4315-9538-7deb9eb0d6a9 req-0e41e02f-3f5d-4a8a-971d-2d4a1ee19a72 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:55.680897 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-89852364-bd41-4315-9538-7deb9eb0d6a9 req-0e41e02f-3f5d-4a8a-971d-2d4a1ee19a72 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:55.686516 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-c9b10060-d459-43b3-b331-ca0b585f4509 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:55.687373 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-c9b10060-d459-43b3-b331-ca0b585f4509 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c2217c82-c31b-4997-a07b-a3f3b15120f2] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:55.699979 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c9b10060-d459-43b3-b331-ca0b585f4509 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:55.700733 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.compute.server_external_events [req-89852364-bd41-4315-9538-7deb9eb0d6a9 req-0e41e02f-3f5d-4a8a-971d-2d4a1ee19a72 service nova] Creating event network-vif-plugged:0e5fd19d-7b69-41f6-849c-97ce9658dc29 for instance 5b927087-6400-4a41-b19e-0e417905395e on hv-cinder-78836 Jan 18 16:32:55.706161 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c9b10060-d459-43b3-b331-ca0b585f4509 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:55.707252 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c9b10060-d459-43b3-b331-ca0b585f4509 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:55.708219 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [req-89852364-bd41-4315-9538-7deb9eb0d6a9 req-0e41e02f-3f5d-4a8a-971d-2d4a1ee19a72 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047422 Jan 18 16:32:55.709372 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 205/424] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:32:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:32:55.711936 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c9b10060-d459-43b3-b331-ca0b585f4509 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:55.894307 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-c9b10060-d459-43b3-b331-ca0b585f4509 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9424067ecef94af9ae0828b77926f675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74e7f75a7c41be9e4e3f6884b4d832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:55.903185 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-c9b10060-d459-43b3-b331-ca0b585f4509 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2" status: 200 len: 1314 microversion: 2.1 time: 0.223780 Jan 18 16:32:55.903935 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 220/425] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:55 2022] GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:32:56.135419 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-ba57ab08-4ef6-4eab-9104-e83794e259a7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:56.136203 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-ba57ab08-4ef6-4eab-9104-e83794e259a7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:56.143953 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ba57ab08-4ef6-4eab-9104-e83794e259a7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:56.144489 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ba57ab08-4ef6-4eab-9104-e83794e259a7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:56.145503 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ba57ab08-4ef6-4eab-9104-e83794e259a7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:56.146047 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ba57ab08-4ef6-4eab-9104-e83794e259a7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:56.254398 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-bc094742-9bd9-4793-ad5d-9c0a6292d6bb tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:56.255857 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-bc094742-9bd9-4793-ad5d-9c0a6292d6bb tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: 5b927087-6400-4a41-b19e-0e417905395e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:56.273652 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-bc094742-9bd9-4793-ad5d-9c0a6292d6bb tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:56.274283 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-bc094742-9bd9-4793-ad5d-9c0a6292d6bb tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:56.275529 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-bc094742-9bd9-4793-ad5d-9c0a6292d6bb tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:56.276270 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-bc094742-9bd9-4793-ad5d-9c0a6292d6bb tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:56.383265 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-ba57ab08-4ef6-4eab-9104-e83794e259a7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:56.397683 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-ba57ab08-4ef6-4eab-9104-e83794e259a7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:56.404522 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-ba57ab08-4ef6-4eab-9104-e83794e259a7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:56.405818 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-ba57ab08-4ef6-4eab-9104-e83794e259a7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1722 microversion: 2.20 time: 0.275688 Jan 18 16:32:56.422539 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 206/426] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:32:56 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1722 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:32:56.428442 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-90298d8f-ef70-4a76-bcb8-dbed08f11ce2 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:56.429203 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-90298d8f-ef70-4a76-bcb8-dbed08f11ce2 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:56.435179 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-90298d8f-ef70-4a76-bcb8-dbed08f11ce2 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:56.435738 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-90298d8f-ef70-4a76-bcb8-dbed08f11ce2 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:56.436621 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-90298d8f-ef70-4a76-bcb8-dbed08f11ce2 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:56.437187 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-90298d8f-ef70-4a76-bcb8-dbed08f11ce2 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:56.457461 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-bc094742-9bd9-4793-ad5d-9c0a6292d6bb tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:56.465519 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-bc094742-9bd9-4793-ad5d-9c0a6292d6bb tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e" status: 200 len: 1265 microversion: 2.1 time: 0.217793 Jan 18 16:32:56.482843 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 221/427] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:56 2022] GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e => generated 1265 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:56.676484 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-90298d8f-ef70-4a76-bcb8-dbed08f11ce2 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:56.692672 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-90298d8f-ef70-4a76-bcb8-dbed08f11ce2 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1566 microversion: 2.1 time: 0.268904 Jan 18 16:32:56.705957 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 207/428] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:56 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1566 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:56.933476 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-09ca3845-5805-4dee-b39e-dd3f9570c39d tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:56.934935 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-09ca3845-5805-4dee-b39e-dd3f9570c39d tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c2217c82-c31b-4997-a07b-a3f3b15120f2] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:56.955721 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-09ca3845-5805-4dee-b39e-dd3f9570c39d tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:56.956263 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-09ca3845-5805-4dee-b39e-dd3f9570c39d tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:56.957124 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-09ca3845-5805-4dee-b39e-dd3f9570c39d tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:56.957561 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-09ca3845-5805-4dee-b39e-dd3f9570c39d tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:57.138044 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-09ca3845-5805-4dee-b39e-dd3f9570c39d tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9424067ecef94af9ae0828b77926f675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74e7f75a7c41be9e4e3f6884b4d832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:57.146972 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-09ca3845-5805-4dee-b39e-dd3f9570c39d tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2" status: 200 len: 1314 microversion: 2.1 time: 0.230440 Jan 18 16:32:57.156953 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 222/429] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:56 2022] GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:57.426389 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-761df62d-cf10-49e7-b3f2-9cc871a1d75c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:57.427201 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-761df62d-cf10-49e7-b3f2-9cc871a1d75c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:57.433639 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-761df62d-cf10-49e7-b3f2-9cc871a1d75c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:57.434331 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-761df62d-cf10-49e7-b3f2-9cc871a1d75c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:57.435305 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-761df62d-cf10-49e7-b3f2-9cc871a1d75c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:57.435895 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-761df62d-cf10-49e7-b3f2-9cc871a1d75c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:57.485246 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-bb7f68bc-4b5c-45d4-9eff-5bd3994aaa89 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:57.487485 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-bb7f68bc-4b5c-45d4-9eff-5bd3994aaa89 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: 5b927087-6400-4a41-b19e-0e417905395e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:57.508189 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-bb7f68bc-4b5c-45d4-9eff-5bd3994aaa89 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:57.508816 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-bb7f68bc-4b5c-45d4-9eff-5bd3994aaa89 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:57.509810 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-bb7f68bc-4b5c-45d4-9eff-5bd3994aaa89 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:57.511386 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-bb7f68bc-4b5c-45d4-9eff-5bd3994aaa89 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:57.733866 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-761df62d-cf10-49e7-b3f2-9cc871a1d75c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:57.746327 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-761df62d-cf10-49e7-b3f2-9cc871a1d75c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:57.748099 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-761df62d-cf10-49e7-b3f2-9cc871a1d75c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:57.749650 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-761df62d-cf10-49e7-b3f2-9cc871a1d75c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1722 microversion: 2.20 time: 0.327431 Jan 18 16:32:57.761031 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 208/430] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:32:57 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1722 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:32:57.765768 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-5eb2310a-c606-467d-8e49-a1b8cfb530f5 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:57.766573 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-5eb2310a-c606-467d-8e49-a1b8cfb530f5 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:57.776817 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-5eb2310a-c606-467d-8e49-a1b8cfb530f5 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:57.777484 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-5eb2310a-c606-467d-8e49-a1b8cfb530f5 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:57.778451 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-5eb2310a-c606-467d-8e49-a1b8cfb530f5 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:57.779790 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-5eb2310a-c606-467d-8e49-a1b8cfb530f5 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:57.894295 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-bb7f68bc-4b5c-45d4-9eff-5bd3994aaa89 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:57.902263 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-bb7f68bc-4b5c-45d4-9eff-5bd3994aaa89 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e" status: 200 len: 1265 microversion: 2.1 time: 0.423882 Jan 18 16:32:57.905308 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 223/431] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:57 2022] GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e => generated 1265 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:57.910352 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [req-e990f1a4-1e54-41c9-a6bd-8805223c5d4b req-a6907470-6844-4f64-9fa9-becb35a4dc47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e9ca525-aad0-4ac6-8879-2c8d0131c2ee", "name": "network-vif-unplugged", "status": "completed", "tag": "ca2a0420-8660-4c5a-8bc5-c3d7fa2913eb"}]} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:32:57.912365 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:32:57.912365 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: warnings.warn(msg) Jan 18 16:32:57.919825 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-e990f1a4-1e54-41c9-a6bd-8805223c5d4b req-a6907470-6844-4f64-9fa9-becb35a4dc47 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:57.920276 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-e990f1a4-1e54-41c9-a6bd-8805223c5d4b req-a6907470-6844-4f64-9fa9-becb35a4dc47 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:57.943960 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.compute.server_external_events [req-e990f1a4-1e54-41c9-a6bd-8805223c5d4b req-a6907470-6844-4f64-9fa9-becb35a4dc47 service nova] Creating event network-vif-unplugged:ca2a0420-8660-4c5a-8bc5-c3d7fa2913eb for instance 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee on hv-cinder-78836 Jan 18 16:32:57.950917 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [req-e990f1a4-1e54-41c9-a6bd-8805223c5d4b req-a6907470-6844-4f64-9fa9-becb35a4dc47 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043563 Jan 18 16:32:57.951982 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 224/432] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:32:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:32:57.998371 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-5eb2310a-c606-467d-8e49-a1b8cfb530f5 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:58.008193 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-5eb2310a-c606-467d-8e49-a1b8cfb530f5 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1546 microversion: 2.1 time: 0.245705 Jan 18 16:32:58.009112 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 209/433] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:57 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1546 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:58.040499 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-1be49c89-4c03-42a1-a4ce-5c1158165b3e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:58.041203 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-1be49c89-4c03-42a1-a4ce-5c1158165b3e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:58.056691 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-1be49c89-4c03-42a1-a4ce-5c1158165b3e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:58.057330 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-1be49c89-4c03-42a1-a4ce-5c1158165b3e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:58.058431 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-1be49c89-4c03-42a1-a4ce-5c1158165b3e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:58.061743 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-1be49c89-4c03-42a1-a4ce-5c1158165b3e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:58.163913 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-6905d58c-b7c5-4cd1-84ef-c8d34122e7e0 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:58.164859 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-6905d58c-b7c5-4cd1-84ef-c8d34122e7e0 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c2217c82-c31b-4997-a07b-a3f3b15120f2] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:58.171968 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-6905d58c-b7c5-4cd1-84ef-c8d34122e7e0 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:58.174555 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-6905d58c-b7c5-4cd1-84ef-c8d34122e7e0 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:58.175654 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-6905d58c-b7c5-4cd1-84ef-c8d34122e7e0 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:58.176320 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-6905d58c-b7c5-4cd1-84ef-c8d34122e7e0 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:58.215129 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.wsgi [None req-1be49c89-4c03-42a1-a4ce-5c1158165b3e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] HTTP exception thrown: Cannot 'detach_volume' instance c862639d-6995-43e1-9c7a-3d4f416629fc while it is in vm_state rescued Jan 18 16:32:58.216028 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-1be49c89-4c03-42a1-a4ce-5c1158165b3e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Returning 409 to user: Cannot 'detach_volume' instance c862639d-6995-43e1-9c7a-3d4f416629fc while it is in vm_state rescued {{(pid=116367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 16:32:58.217365 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-1be49c89-4c03-42a1-a4ce-5c1158165b3e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "DELETE /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc/os-volume_attachments/c92ed41f-79cd-4a52-83a8-2f69ce176d7a" status: 409 len: 152 microversion: 2.1 time: 0.188234 Jan 18 16:32:58.218347 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 225/434] 10.222.0.82 () {58 vars in 1415 bytes} [Tue Jan 18 16:32:58 2022] DELETE /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc/os-volume_attachments/c92ed41f-79cd-4a52-83a8-2f69ce176d7a => generated 152 bytes in 190 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 18 16:32:58.238240 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-2d19a513-dcc6-4360-a94a-3b7997fe9611 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:32:58.239266 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-2d19a513-dcc6-4360-a94a-3b7997fe9611 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:58.256651 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2d19a513-dcc6-4360-a94a-3b7997fe9611 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:58.256651 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2d19a513-dcc6-4360-a94a-3b7997fe9611 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:58.258154 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2d19a513-dcc6-4360-a94a-3b7997fe9611 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:58.258681 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2d19a513-dcc6-4360-a94a-3b7997fe9611 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:58.386540 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-6905d58c-b7c5-4cd1-84ef-c8d34122e7e0 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9424067ecef94af9ae0828b77926f675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74e7f75a7c41be9e4e3f6884b4d832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:58.396990 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-6905d58c-b7c5-4cd1-84ef-c8d34122e7e0 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2" status: 200 len: 1314 microversion: 2.1 time: 0.237039 Jan 18 16:32:58.398417 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 210/435] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:58 2022] GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:58.404861 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-2d19a513-dcc6-4360-a94a-3b7997fe9611 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "POST /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc/action" status: 202 len: 0 microversion: 2.1 time: 0.176054 Jan 18 16:32:58.409101 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 226/436] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:32:58 2022] POST /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:32:58.414104 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-fd5147ba-c099-46cd-ad16-567263d6dff0 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:58.414829 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-fd5147ba-c099-46cd-ad16-567263d6dff0 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:58.430738 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-fd5147ba-c099-46cd-ad16-567263d6dff0 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:58.433866 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-fd5147ba-c099-46cd-ad16-567263d6dff0 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:58.435335 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-fd5147ba-c099-46cd-ad16-567263d6dff0 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:58.436021 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-fd5147ba-c099-46cd-ad16-567263d6dff0 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:58.603475 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-fd5147ba-c099-46cd-ad16-567263d6dff0 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:58.612970 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-fd5147ba-c099-46cd-ad16-567263d6dff0 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1554 microversion: 2.1 time: 0.202534 Jan 18 16:32:58.616108 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 211/437] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:58 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1554 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:58.767863 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-79cf9cbb-f4db-44a8-bc86-4fd63bf78035 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:58.768758 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-79cf9cbb-f4db-44a8-bc86-4fd63bf78035 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:58.780838 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-79cf9cbb-f4db-44a8-bc86-4fd63bf78035 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:58.781322 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-79cf9cbb-f4db-44a8-bc86-4fd63bf78035 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:58.782290 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-79cf9cbb-f4db-44a8-bc86-4fd63bf78035 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:58.782613 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-79cf9cbb-f4db-44a8-bc86-4fd63bf78035 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:58.919170 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-846939b9-3d63-4529-a7ee-ed2556d2f048 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:58.919772 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-846939b9-3d63-4529-a7ee-ed2556d2f048 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: 5b927087-6400-4a41-b19e-0e417905395e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:58.929967 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-846939b9-3d63-4529-a7ee-ed2556d2f048 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:58.930686 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-846939b9-3d63-4529-a7ee-ed2556d2f048 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:58.931692 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-846939b9-3d63-4529-a7ee-ed2556d2f048 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:58.934161 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-846939b9-3d63-4529-a7ee-ed2556d2f048 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:59.015797 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-79cf9cbb-f4db-44a8-bc86-4fd63bf78035 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:59.027854 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-79cf9cbb-f4db-44a8-bc86-4fd63bf78035 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:59.029805 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-79cf9cbb-f4db-44a8-bc86-4fd63bf78035 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:59.034608 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-79cf9cbb-f4db-44a8-bc86-4fd63bf78035 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1722 microversion: 2.20 time: 0.270848 Jan 18 16:32:59.036066 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 227/438] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:32:58 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1722 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:32:59.212797 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-846939b9-3d63-4529-a7ee-ed2556d2f048 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:59.224604 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-846939b9-3d63-4529-a7ee-ed2556d2f048 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e" status: 200 len: 1265 microversion: 2.1 time: 0.309387 Jan 18 16:32:59.225679 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 212/439] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:58 2022] GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e => generated 1265 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:59.416162 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-8b3f25b2-4028-4090-97f0-b5df54c07755 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:59.416805 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-8b3f25b2-4028-4090-97f0-b5df54c07755 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c2217c82-c31b-4997-a07b-a3f3b15120f2] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:59.424690 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-8b3f25b2-4028-4090-97f0-b5df54c07755 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:59.425276 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-8b3f25b2-4028-4090-97f0-b5df54c07755 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:59.426307 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-8b3f25b2-4028-4090-97f0-b5df54c07755 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:59.426826 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-8b3f25b2-4028-4090-97f0-b5df54c07755 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:59.614200 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-8b3f25b2-4028-4090-97f0-b5df54c07755 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9424067ecef94af9ae0828b77926f675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74e7f75a7c41be9e4e3f6884b4d832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:59.637017 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-947562e3-958b-48f3-a033-ff531bb0354e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:32:59.637892 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-947562e3-958b-48f3-a033-ff531bb0354e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:32:59.648598 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-8b3f25b2-4028-4090-97f0-b5df54c07755 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2" status: 200 len: 1314 microversion: 2.1 time: 0.214191 Jan 18 16:32:59.649696 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 228/440] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:59 2022] GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:32:59.665474 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-947562e3-958b-48f3-a033-ff531bb0354e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:59.666051 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-947562e3-958b-48f3-a033-ff531bb0354e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:59.667039 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-947562e3-958b-48f3-a033-ff531bb0354e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:32:59.667417 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-947562e3-958b-48f3-a033-ff531bb0354e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:32:59.841045 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-947562e3-958b-48f3-a033-ff531bb0354e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:32:59.852159 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-947562e3-958b-48f3-a033-ff531bb0354e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1554 microversion: 2.1 time: 0.224235 Jan 18 16:32:59.857496 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 213/441] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:32:59 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1554 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:33:00.052965 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-f309e2d6-ac27-4b79-895c-921ebe91ddc1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:00.053770 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-f309e2d6-ac27-4b79-895c-921ebe91ddc1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:00.061305 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-f309e2d6-ac27-4b79-895c-921ebe91ddc1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:00.061305 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-f309e2d6-ac27-4b79-895c-921ebe91ddc1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:00.061602 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-f309e2d6-ac27-4b79-895c-921ebe91ddc1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:00.061918 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-f309e2d6-ac27-4b79-895c-921ebe91ddc1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:00.242104 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-7523dddb-e5f8-42ba-9f49-9790bca6a981 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:00.243532 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-7523dddb-e5f8-42ba-9f49-9790bca6a981 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: 5b927087-6400-4a41-b19e-0e417905395e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:00.250036 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7523dddb-e5f8-42ba-9f49-9790bca6a981 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:00.250495 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7523dddb-e5f8-42ba-9f49-9790bca6a981 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:00.251356 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7523dddb-e5f8-42ba-9f49-9790bca6a981 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:00.251798 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7523dddb-e5f8-42ba-9f49-9790bca6a981 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:00.287119 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-f309e2d6-ac27-4b79-895c-921ebe91ddc1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:00.297443 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-f309e2d6-ac27-4b79-895c-921ebe91ddc1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:00.299755 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-f309e2d6-ac27-4b79-895c-921ebe91ddc1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:00.301279 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-f309e2d6-ac27-4b79-895c-921ebe91ddc1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1722 microversion: 2.20 time: 0.251950 Jan 18 16:33:00.302493 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 229/442] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:33:00 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1722 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 16:33:00.487933 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-7523dddb-e5f8-42ba-9f49-9790bca6a981 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:00.497868 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-7523dddb-e5f8-42ba-9f49-9790bca6a981 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e" status: 200 len: 1453 microversion: 2.1 time: 0.259334 Jan 18 16:33:00.499159 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 214/443] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:00 2022] GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e => generated 1453 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:00.521009 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-92503f53-8842-454d-a691-84f3a606b80c tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:00.521805 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-92503f53-8842-454d-a691-84f3a606b80c tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: 5b927087-6400-4a41-b19e-0e417905395e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:00.531706 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-92503f53-8842-454d-a691-84f3a606b80c tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:00.532372 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-92503f53-8842-454d-a691-84f3a606b80c tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:00.537580 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-92503f53-8842-454d-a691-84f3a606b80c tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:00.538195 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-92503f53-8842-454d-a691-84f3a606b80c tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:00.672530 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-52ed0a57-34a0-46c8-b61c-dbc2bd79532b tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:00.675584 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-52ed0a57-34a0-46c8-b61c-dbc2bd79532b tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c2217c82-c31b-4997-a07b-a3f3b15120f2] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:00.691510 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-52ed0a57-34a0-46c8-b61c-dbc2bd79532b tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:00.697101 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-52ed0a57-34a0-46c8-b61c-dbc2bd79532b tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:00.698290 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-52ed0a57-34a0-46c8-b61c-dbc2bd79532b tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:00.700820 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-52ed0a57-34a0-46c8-b61c-dbc2bd79532b tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:00.744785 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-92503f53-8842-454d-a691-84f3a606b80c tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:00.757514 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-92503f53-8842-454d-a691-84f3a606b80c tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e" status: 200 len: 1453 microversion: 2.1 time: 0.241250 Jan 18 16:33:00.758115 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 230/444] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:00 2022] GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e => generated 1453 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:00.871891 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-91a44256-8d8a-4779-845d-35c44930e41a tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:00.873035 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-91a44256-8d8a-4779-845d-35c44930e41a tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:00.894004 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-91a44256-8d8a-4779-845d-35c44930e41a tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:00.894456 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-91a44256-8d8a-4779-845d-35c44930e41a tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:00.895260 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-91a44256-8d8a-4779-845d-35c44930e41a tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:00.895694 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-91a44256-8d8a-4779-845d-35c44930e41a tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:01.053799 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-52ed0a57-34a0-46c8-b61c-dbc2bd79532b tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9424067ecef94af9ae0828b77926f675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74e7f75a7c41be9e4e3f6884b4d832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:01.066896 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-52ed0a57-34a0-46c8-b61c-dbc2bd79532b tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2" status: 200 len: 1314 microversion: 2.1 time: 0.401234 Jan 18 16:33:01.067667 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 215/445] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:00 2022] GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2 => generated 1314 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:33:01.315112 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-91a44256-8d8a-4779-845d-35c44930e41a tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:01.327663 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-6a786468-d70f-4e98-ad0c-061b02243880 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:01.330072 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-6a786468-d70f-4e98-ad0c-061b02243880 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:01.330957 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-91a44256-8d8a-4779-845d-35c44930e41a tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1554 microversion: 2.1 time: 0.463717 Jan 18 16:33:01.333792 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 231/446] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:00 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1554 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:01.351840 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-6a786468-d70f-4e98-ad0c-061b02243880 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:01.352483 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-6a786468-d70f-4e98-ad0c-061b02243880 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:01.353341 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-6a786468-d70f-4e98-ad0c-061b02243880 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:01.354359 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-6a786468-d70f-4e98-ad0c-061b02243880 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:01.665358 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-6a786468-d70f-4e98-ad0c-061b02243880 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:01.674350 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-6a786468-d70f-4e98-ad0c-061b02243880 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:01.679969 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-6a786468-d70f-4e98-ad0c-061b02243880 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:01.688148 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-6a786468-d70f-4e98-ad0c-061b02243880 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1665 microversion: 2.20 time: 0.364379 Jan 18 16:33:01.688854 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 216/447] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:33:01 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1665 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 16:33:01.725977 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-3276ce95-4d2a-4c00-9d7f-90322951cbfb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "619e0846-ef6d-41ef-971c-52afd9c21aad"}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:33:01.727590 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-3276ce95-4d2a-4c00-9d7f-90322951cbfb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:01.741708 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-3276ce95-4d2a-4c00-9d7f-90322951cbfb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:01.743608 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-3276ce95-4d2a-4c00-9d7f-90322951cbfb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:01.746477 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-3276ce95-4d2a-4c00-9d7f-90322951cbfb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:01.746912 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-3276ce95-4d2a-4c00-9d7f-90322951cbfb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:02.083488 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-0ba4fd6f-a292-48a2-8e9d-d78a000c37f2 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:02.085116 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-0ba4fd6f-a292-48a2-8e9d-d78a000c37f2 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c2217c82-c31b-4997-a07b-a3f3b15120f2] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:02.094463 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0ba4fd6f-a292-48a2-8e9d-d78a000c37f2 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:02.096236 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0ba4fd6f-a292-48a2-8e9d-d78a000c37f2 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:02.097253 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0ba4fd6f-a292-48a2-8e9d-d78a000c37f2 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:02.098338 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0ba4fd6f-a292-48a2-8e9d-d78a000c37f2 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:02.314286 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-3276ce95-4d2a-4c00-9d7f-90322951cbfb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.611062 Jan 18 16:33:02.320351 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 232/448] 10.222.0.82 () {62 vars in 1363 bytes} [Tue Jan 18 16:33:01 2022] POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/os-volume_attachments => generated 188 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:33:02.351695 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-5a277614-a287-4f5a-8db4-abfe4667129e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:02.353179 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-5a277614-a287-4f5a-8db4-abfe4667129e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:02.356822 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-0ba4fd6f-a292-48a2-8e9d-d78a000c37f2 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9424067ecef94af9ae0828b77926f675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74e7f75a7c41be9e4e3f6884b4d832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:02.363937 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-5a277614-a287-4f5a-8db4-abfe4667129e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:02.367385 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-5a277614-a287-4f5a-8db4-abfe4667129e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:02.368205 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-5a277614-a287-4f5a-8db4-abfe4667129e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:02.368867 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-5a277614-a287-4f5a-8db4-abfe4667129e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:02.370156 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-0ba4fd6f-a292-48a2-8e9d-d78a000c37f2 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2" status: 200 len: 1314 microversion: 2.1 time: 0.290318 Jan 18 16:33:02.370739 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 217/449] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:02 2022] GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2 => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:33:02.451774 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-fdd814fe-51e2-456d-a4c8-32ed8adf862c tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Action: 'create', calling method: .version_select at 0x7f33a4b14a60>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1007068540"}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:33:02.473564 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.quota [None req-fdd814fe-51e2-456d-a4c8-32ed8adf862c tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Getting quotas for project b620d20ca2a943d7a89c58c0c1c74b20. Resources: {'key_pairs'} {{(pid=116368) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 16:33:02.478409 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.quota [None req-fdd814fe-51e2-456d-a4c8-32ed8adf862c tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Getting quotas for user 0509d42df8844400b99d7c060ab98c51 and project b620d20ca2a943d7a89c58c0c1c74b20. Resources: {'key_pairs'} {{(pid=116368) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 16:33:02.573339 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-5a277614-a287-4f5a-8db4-abfe4667129e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:02.582081 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-5a277614-a287-4f5a-8db4-abfe4667129e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1560 microversion: 2.1 time: 0.234942 Jan 18 16:33:02.583908 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 233/450] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:02 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1560 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:33:02.598684 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-9c0fb514-56a5-42e0-83d2-cb825dd4c44c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:33:02.599643 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-9c0fb514-56a5-42e0-83d2-cb825dd4c44c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:02.621955 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-9c0fb514-56a5-42e0-83d2-cb825dd4c44c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:02.622882 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-9c0fb514-56a5-42e0-83d2-cb825dd4c44c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:02.629555 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.quota [None req-fdd814fe-51e2-456d-a4c8-32ed8adf862c tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Getting quotas for project b620d20ca2a943d7a89c58c0c1c74b20. Resources: {'key_pairs'} {{(pid=116368) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 16:33:02.631723 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-9c0fb514-56a5-42e0-83d2-cb825dd4c44c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:02.632405 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-9c0fb514-56a5-42e0-83d2-cb825dd4c44c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:02.635038 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.quota [None req-fdd814fe-51e2-456d-a4c8-32ed8adf862c tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Getting quotas for user 0509d42df8844400b99d7c060ab98c51 and project b620d20ca2a943d7a89c58c0c1c74b20. Resources: {'key_pairs'} {{(pid=116368) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 16:33:02.662022 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-fdd814fe-51e2-456d-a4c8-32ed8adf862c tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.214097 Jan 18 16:33:02.662881 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 218/451] 10.222.0.82 () {60 vars in 1157 bytes} [Tue Jan 18 16:33:02 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:33:02.683314 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-ccf6ecd3-bf12-4bed-b36f-5c3c21bf1951 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:02.684050 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-ccf6ecd3-bf12-4bed-b36f-5c3c21bf1951 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:02.693621 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ccf6ecd3-bf12-4bed-b36f-5c3c21bf1951 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:02.694384 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ccf6ecd3-bf12-4bed-b36f-5c3c21bf1951 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:02.695428 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ccf6ecd3-bf12-4bed-b36f-5c3c21bf1951 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:02.696108 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ccf6ecd3-bf12-4bed-b36f-5c3c21bf1951 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:02.821744 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-9c0fb514-56a5-42e0-83d2-cb825dd4c44c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action" status: 202 len: 0 microversion: 2.20 time: 0.236319 Jan 18 16:33:02.822794 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 234/452] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:33:02 2022] POST /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 18 16:33:02.827536 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-c5d41bfc-66b7-4d15-a72f-d039db6e27b5 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-252019201", "imageRef": "56f00555-877c-4b44-9a4d-a04ef2297c09", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1007068540", "networks": [{"uuid": "b1823f9d-1b6a-4242-91de-f4c8c181443c"}]}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:33:02.904337 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.objects.instance [None req-ccf6ecd3-bf12-4bed-b36f-5c3c21bf1951 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lazy-loading 'services' on Instance uuid c862639d-6995-43e1-9c7a-3d4f416629fc {{(pid=116368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 18 16:33:02.927756 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.network.neutron [None req-c5d41bfc-66b7-4d15-a72f-d039db6e27b5 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] validate_networks() for [('b1823f9d-1b6a-4242-91de-f4c8c181443c', None, None, None, None, None)] {{(pid=116367) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 18 16:33:03.107018 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-ccf6ecd3-bf12-4bed-b36f-5c3c21bf1951 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "DELETE /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc/os-volume_attachments/c92ed41f-79cd-4a52-83a8-2f69ce176d7a" status: 202 len: 0 microversion: 2.1 time: 0.429997 Jan 18 16:33:03.111927 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 219/453] 10.222.0.82 () {58 vars in 1415 bytes} [Tue Jan 18 16:33:02 2022] DELETE /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc/os-volume_attachments/c92ed41f-79cd-4a52-83a8-2f69ce176d7a => generated 0 bytes in 433 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:33:03.131898 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-6eb96a3a-9ade-49f3-9b6e-fe66477560a1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:03.133213 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-6eb96a3a-9ade-49f3-9b6e-fe66477560a1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:03.150114 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-6eb96a3a-9ade-49f3-9b6e-fe66477560a1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:03.150839 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-6eb96a3a-9ade-49f3-9b6e-fe66477560a1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:03.151980 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-6eb96a3a-9ade-49f3-9b6e-fe66477560a1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:03.153704 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-6eb96a3a-9ade-49f3-9b6e-fe66477560a1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:03.429958 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-6eb96a3a-9ade-49f3-9b6e-fe66477560a1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:03.443612 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-6eb96a3a-9ade-49f3-9b6e-fe66477560a1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:03.447606 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-6eb96a3a-9ade-49f3-9b6e-fe66477560a1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:03.451206 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-6eb96a3a-9ade-49f3-9b6e-fe66477560a1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1751 microversion: 2.20 time: 0.339582 Jan 18 16:33:03.452200 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 220/454] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:33:03 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1751 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:33:03.462650 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-697397ac-1601-4087-832c-7f713b5a7929 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:03.464220 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-697397ac-1601-4087-832c-7f713b5a7929 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:03.480057 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-697397ac-1601-4087-832c-7f713b5a7929 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:03.485186 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-697397ac-1601-4087-832c-7f713b5a7929 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:03.487241 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-697397ac-1601-4087-832c-7f713b5a7929 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:03.487907 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-697397ac-1601-4087-832c-7f713b5a7929 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:03.549917 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-697397ac-1601-4087-832c-7f713b5a7929 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093139 Jan 18 16:33:03.550982 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 221/455] 10.222.0.82 () {58 vars in 1301 bytes} [Tue Jan 18 16:33:03 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:33:03.560779 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-1cc30edf-96ed-4962-a84a-22c8724b42bd tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:03.562080 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-1cc30edf-96ed-4962-a84a-22c8724b42bd tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c2217c82-c31b-4997-a07b-a3f3b15120f2] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:03.571595 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1cc30edf-96ed-4962-a84a-22c8724b42bd tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:03.572405 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1cc30edf-96ed-4962-a84a-22c8724b42bd tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:03.574057 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1cc30edf-96ed-4962-a84a-22c8724b42bd tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:03.574706 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1cc30edf-96ed-4962-a84a-22c8724b42bd tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:03.597190 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.virt.hardware [None req-c5d41bfc-66b7-4d15-a72f-d039db6e27b5 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Flavor limits 0:0:0 {{(pid=116367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 18 16:33:03.597766 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.virt.hardware [None req-c5d41bfc-66b7-4d15-a72f-d039db6e27b5 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Image limits 0:0:0 {{(pid=116367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 18 16:33:03.598078 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.virt.hardware [None req-c5d41bfc-66b7-4d15-a72f-d039db6e27b5 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Flavor pref 0:0:0 {{(pid=116367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 18 16:33:03.598488 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.virt.hardware [None req-c5d41bfc-66b7-4d15-a72f-d039db6e27b5 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Image pref 0:0:0 {{(pid=116367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 18 16:33:03.598900 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.virt.hardware [None req-c5d41bfc-66b7-4d15-a72f-d039db6e27b5 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 18 16:33:03.612339 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c5d41bfc-66b7-4d15-a72f-d039db6e27b5 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:03.612798 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c5d41bfc-66b7-4d15-a72f-d039db6e27b5 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:03.613683 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c5d41bfc-66b7-4d15-a72f-d039db6e27b5 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:03.614054 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c5d41bfc-66b7-4d15-a72f-d039db6e27b5 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:03.659454 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.quota [None req-c5d41bfc-66b7-4d15-a72f-d039db6e27b5 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Getting quotas for project b620d20ca2a943d7a89c58c0c1c74b20. Resources: {'ram', 'instances', 'cores'} {{(pid=116367) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 16:33:03.677367 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.quota [None req-c5d41bfc-66b7-4d15-a72f-d039db6e27b5 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Getting quotas for user 0509d42df8844400b99d7c060ab98c51 and project b620d20ca2a943d7a89c58c0c1c74b20. Resources: {'ram', 'instances', 'cores'} {{(pid=116367) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 16:33:03.695966 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-c5d41bfc-66b7-4d15-a72f-d039db6e27b5 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Going to run 1 instances... {{(pid=116367) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 18 16:33:03.706969 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-c5d41bfc-66b7-4d15-a72f-d039db6e27b5 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56f00555-877c-4b44-9a4d-a04ef2297c09',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 18 16:33:03.785572 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-c5d41bfc-66b7-4d15-a72f-d039db6e27b5 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.961477 Jan 18 16:33:03.786236 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 235/456] 10.222.0.82 () {60 vars in 1146 bytes} [Tue Jan 18 16:33:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 963 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 18 16:33:03.795985 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-798d8d80-65f8-49b5-ac79-486eae6a9733 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:03.796596 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-798d8d80-65f8-49b5-ac79-486eae6a9733 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:03.943313 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-1cc30edf-96ed-4962-a84a-22c8724b42bd tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9424067ecef94af9ae0828b77926f675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74e7f75a7c41be9e4e3f6884b4d832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:03.954385 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-1cc30edf-96ed-4962-a84a-22c8724b42bd tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2" status: 200 len: 1314 microversion: 2.1 time: 0.400769 Jan 18 16:33:03.955175 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 222/457] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:03 2022] GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2 => generated 1314 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:03.958178 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-798d8d80-65f8-49b5-ac79-486eae6a9733 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0509d42df8844400b99d7c060ab98c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:03.981734 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-798d8d80-65f8-49b5-ac79-486eae6a9733 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 200 len: 1258 microversion: 2.1 time: 0.189163 Jan 18 16:33:03.982860 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 236/458] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:03 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 1258 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:04.080297 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [req-b26316c7-a111-4f24-b911-550a73f4f4e5 req-7056d1dd-d4a3-4dd0-8ecf-b0aa7cbde568 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b927087-6400-4a41-b19e-0e417905395e", "tag": "0e5fd19d-7b69-41f6-849c-97ce9658dc29"}]} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:33:04.082108 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:33:04.082108 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: warnings.warn(msg) Jan 18 16:33:04.094420 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-b26316c7-a111-4f24-b911-550a73f4f4e5 req-7056d1dd-d4a3-4dd0-8ecf-b0aa7cbde568 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:04.095005 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-b26316c7-a111-4f24-b911-550a73f4f4e5 req-7056d1dd-d4a3-4dd0-8ecf-b0aa7cbde568 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:04.144795 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.compute.server_external_events [req-b26316c7-a111-4f24-b911-550a73f4f4e5 req-7056d1dd-d4a3-4dd0-8ecf-b0aa7cbde568 service nova] Creating event network-changed:0e5fd19d-7b69-41f6-849c-97ce9658dc29 for instance 5b927087-6400-4a41-b19e-0e417905395e on hv-cinder-78836 Jan 18 16:33:04.157541 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [req-b26316c7-a111-4f24-b911-550a73f4f4e5 req-7056d1dd-d4a3-4dd0-8ecf-b0aa7cbde568 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080972 Jan 18 16:33:04.159473 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 223/459] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 16:33:04.471190 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-fb073dce-651c-49e2-bed6-a6379a609186 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:04.471414 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-fb073dce-651c-49e2-bed6-a6379a609186 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:04.487714 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-fb073dce-651c-49e2-bed6-a6379a609186 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:04.492830 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-fb073dce-651c-49e2-bed6-a6379a609186 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:04.494121 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-fb073dce-651c-49e2-bed6-a6379a609186 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:04.494565 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-fb073dce-651c-49e2-bed6-a6379a609186 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:04.563136 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-06017ef0-0e09-4172-9561-cb265c1e584f tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:04.566240 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-06017ef0-0e09-4172-9561-cb265c1e584f tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:04.581379 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-06017ef0-0e09-4172-9561-cb265c1e584f tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:04.582228 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-06017ef0-0e09-4172-9561-cb265c1e584f tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:04.584037 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-06017ef0-0e09-4172-9561-cb265c1e584f tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:04.584631 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-06017ef0-0e09-4172-9561-cb265c1e584f tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:04.679694 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-06017ef0-0e09-4172-9561-cb265c1e584f tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.121182 Jan 18 16:33:04.680282 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 224/460] 10.222.0.82 () {58 vars in 1301 bytes} [Tue Jan 18 16:33:04 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc/os-volume_attachments => generated 25 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 18 16:33:04.974128 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-d32f91f0-7cef-4693-ad68-13f24e559c82 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:04.975198 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-d32f91f0-7cef-4693-ad68-13f24e559c82 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c2217c82-c31b-4997-a07b-a3f3b15120f2] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:04.987013 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d32f91f0-7cef-4693-ad68-13f24e559c82 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:04.987557 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d32f91f0-7cef-4693-ad68-13f24e559c82 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:04.990129 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d32f91f0-7cef-4693-ad68-13f24e559c82 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:04.995394 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d32f91f0-7cef-4693-ad68-13f24e559c82 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:05.323408 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-d32f91f0-7cef-4693-ad68-13f24e559c82 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9424067ecef94af9ae0828b77926f675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74e7f75a7c41be9e4e3f6884b4d832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:05.335055 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-d32f91f0-7cef-4693-ad68-13f24e559c82 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2" status: 200 len: 1314 microversion: 2.1 time: 0.367417 Jan 18 16:33:05.346633 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 225/461] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:04 2022] GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2 => generated 1314 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:33:05.356624 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-87648f58-a801-4bc7-a421-4f6d2ab7eca1 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:05.357478 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-87648f58-a801-4bc7-a421-4f6d2ab7eca1 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:05.359599 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-fb073dce-651c-49e2-bed6-a6379a609186 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:05.364013 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-87648f58-a801-4bc7-a421-4f6d2ab7eca1 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:05.364619 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-87648f58-a801-4bc7-a421-4f6d2ab7eca1 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:05.365712 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-87648f58-a801-4bc7-a421-4f6d2ab7eca1 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:05.366312 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-87648f58-a801-4bc7-a421-4f6d2ab7eca1 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:05.371353 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-fb073dce-651c-49e2-bed6-a6379a609186 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:05.373568 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-fb073dce-651c-49e2-bed6-a6379a609186 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:05.384265 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-fb073dce-651c-49e2-bed6-a6379a609186 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1751 microversion: 2.20 time: 0.911058 Jan 18 16:33:05.408196 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 237/462] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:33:04 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1751 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:33:05.417443 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [req-00cbb29a-8c58-456e-a224-924240c64e43 req-40e6a48d-d654-445b-a352-45208fa2b3bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2217c82-c31b-4997-a07b-a3f3b15120f2", "name": "network-vif-plugged", "status": "completed", "tag": "b39ad36c-c85b-4774-a7c4-2ec833039594"}]} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:33:05.420306 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:33:05.420306 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: warnings.warn(msg) Jan 18 16:33:05.455856 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-00cbb29a-8c58-456e-a224-924240c64e43 req-40e6a48d-d654-445b-a352-45208fa2b3bc service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:05.457073 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-00cbb29a-8c58-456e-a224-924240c64e43 req-40e6a48d-d654-445b-a352-45208fa2b3bc service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:05.460889 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-87648f58-a801-4bc7-a421-4f6d2ab7eca1 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0509d42df8844400b99d7c060ab98c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:05.472686 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-87648f58-a801-4bc7-a421-4f6d2ab7eca1 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 200 len: 1310 microversion: 2.1 time: 0.123100 Jan 18 16:33:05.473695 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 226/463] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:05 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 1310 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:05.508981 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.compute.server_external_events [req-00cbb29a-8c58-456e-a224-924240c64e43 req-40e6a48d-d654-445b-a352-45208fa2b3bc service nova] Creating event network-vif-plugged:b39ad36c-c85b-4774-a7c4-2ec833039594 for instance c2217c82-c31b-4997-a07b-a3f3b15120f2 on hv-cinder-78836 Jan 18 16:33:05.524022 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [req-00cbb29a-8c58-456e-a224-924240c64e43 req-40e6a48d-d654-445b-a352-45208fa2b3bc service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114237 Jan 18 16:33:05.524632 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 238/464] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:33:06.029511 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-3d697343-8f27-4df9-aa76-c730711feb00 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d95934c9-67f3-4ff8-a6bb-6d5c0ac5c816", "device": "/dev/sdb"}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:33:06.031707 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-3d697343-8f27-4df9-aa76-c730711feb00 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] [instance: 74592942-1569-4db1-bcdb-5f0cf97bea6e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:06.041122 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3d697343-8f27-4df9-aa76-c730711feb00 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:06.041805 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3d697343-8f27-4df9-aa76-c730711feb00 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:06.042808 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3d697343-8f27-4df9-aa76-c730711feb00 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:06.043326 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3d697343-8f27-4df9-aa76-c730711feb00 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:06.354633 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-132799e0-8379-4186-87a3-22d926c38b66 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:06.355436 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-132799e0-8379-4186-87a3-22d926c38b66 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c2217c82-c31b-4997-a07b-a3f3b15120f2] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:06.379475 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-132799e0-8379-4186-87a3-22d926c38b66 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:06.382986 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-132799e0-8379-4186-87a3-22d926c38b66 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:06.384820 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-132799e0-8379-4186-87a3-22d926c38b66 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:06.385976 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-132799e0-8379-4186-87a3-22d926c38b66 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:06.561078 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-3d697343-8f27-4df9-aa76-c730711feb00 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] 10.222.0.82 "POST /compute/v2.1/servers/74592942-1569-4db1-bcdb-5f0cf97bea6e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.535128 Jan 18 16:33:06.562179 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 227/465] 10.222.0.82 () {60 vars in 1322 bytes} [Tue Jan 18 16:33:06 2022] POST /compute/v2.1/servers/74592942-1569-4db1-bcdb-5f0cf97bea6e/os-volume_attachments => generated 194 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:33:06.598443 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-e0fd5067-3e04-4ccf-934f-4f70a48bcadf tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:06.599831 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-e0fd5067-3e04-4ccf-934f-4f70a48bcadf tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:06.609838 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e0fd5067-3e04-4ccf-934f-4f70a48bcadf tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:06.610287 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e0fd5067-3e04-4ccf-934f-4f70a48bcadf tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:06.612332 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e0fd5067-3e04-4ccf-934f-4f70a48bcadf tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:06.613212 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e0fd5067-3e04-4ccf-934f-4f70a48bcadf tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:06.764279 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-132799e0-8379-4186-87a3-22d926c38b66 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9424067ecef94af9ae0828b77926f675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74e7f75a7c41be9e4e3f6884b4d832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:06.780793 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-132799e0-8379-4186-87a3-22d926c38b66 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2" status: 200 len: 1314 microversion: 2.1 time: 0.431468 Jan 18 16:33:06.784752 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 239/466] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:06 2022] GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2 => generated 1314 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:33:06.791620 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-e7433758-736e-4540-a0f3-2ff7f080031b tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:06.797504 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-e7433758-736e-4540-a0f3-2ff7f080031b tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:06.806026 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e7433758-736e-4540-a0f3-2ff7f080031b tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:06.806670 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e7433758-736e-4540-a0f3-2ff7f080031b tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:06.807639 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e7433758-736e-4540-a0f3-2ff7f080031b tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:06.808230 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e7433758-736e-4540-a0f3-2ff7f080031b tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:07.051324 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-e0fd5067-3e04-4ccf-934f-4f70a48bcadf tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:07.064869 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-e0fd5067-3e04-4ccf-934f-4f70a48bcadf tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:07.070577 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-e0fd5067-3e04-4ccf-934f-4f70a48bcadf tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:07.071831 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-e0fd5067-3e04-4ccf-934f-4f70a48bcadf tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1809 microversion: 2.20 time: 0.508393 Jan 18 16:33:07.086294 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 228/467] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:33:06 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1809 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:33:07.200122 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-e7433758-736e-4540-a0f3-2ff7f080031b tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0509d42df8844400b99d7c060ab98c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:07.208207 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-e7433758-736e-4540-a0f3-2ff7f080031b tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 200 len: 1358 microversion: 2.1 time: 0.421994 Jan 18 16:33:07.214618 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 240/468] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:06 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 1358 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:07.329605 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-a320a5be-8535-4b0a-98a6-93a88967b943 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:07.330472 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-a320a5be-8535-4b0a-98a6-93a88967b943 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:07.345288 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a320a5be-8535-4b0a-98a6-93a88967b943 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:07.349533 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a320a5be-8535-4b0a-98a6-93a88967b943 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:07.350826 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a320a5be-8535-4b0a-98a6-93a88967b943 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:07.351665 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a320a5be-8535-4b0a-98a6-93a88967b943 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:07.410929 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-a320a5be-8535-4b0a-98a6-93a88967b943 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Going to try to terminate instance {{(pid=116368) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 18 16:33:07.596263 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-a320a5be-8535-4b0a-98a6-93a88967b943 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "DELETE /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 204 len: 0 microversion: 2.1 time: 0.268874 Jan 18 16:33:07.596263 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 229/469] 10.222.0.82 () {58 vars in 1238 bytes} [Tue Jan 18 16:33:07 2022] DELETE /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 18 16:33:07.604451 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-f06e7e05-484d-4842-9274-d3c39be75e61 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:07.605311 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-f06e7e05-484d-4842-9274-d3c39be75e61 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:07.618519 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-f06e7e05-484d-4842-9274-d3c39be75e61 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:07.619198 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-f06e7e05-484d-4842-9274-d3c39be75e61 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:07.622491 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-f06e7e05-484d-4842-9274-d3c39be75e61 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:07.623207 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-f06e7e05-484d-4842-9274-d3c39be75e61 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:07.803148 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-c6282e2a-92ee-46ff-85e2-5fd2c7b699f5 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:07.804194 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-c6282e2a-92ee-46ff-85e2-5fd2c7b699f5 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c2217c82-c31b-4997-a07b-a3f3b15120f2] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:07.811213 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c6282e2a-92ee-46ff-85e2-5fd2c7b699f5 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:07.816139 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c6282e2a-92ee-46ff-85e2-5fd2c7b699f5 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:07.817328 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c6282e2a-92ee-46ff-85e2-5fd2c7b699f5 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:07.821793 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c6282e2a-92ee-46ff-85e2-5fd2c7b699f5 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:08.314840 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-f06e7e05-484d-4842-9274-d3c39be75e61 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:08.332292 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-f06e7e05-484d-4842-9274-d3c39be75e61 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1506 microversion: 2.1 time: 0.731730 Jan 18 16:33:08.333097 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 241/470] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:07 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1506 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:08.337901 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-a2fdd980-2eba-44af-b7c3-4882199a855f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:08.338877 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-a2fdd980-2eba-44af-b7c3-4882199a855f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:08.347437 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-c6282e2a-92ee-46ff-85e2-5fd2c7b699f5 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9424067ecef94af9ae0828b77926f675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74e7f75a7c41be9e4e3f6884b4d832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:08.351309 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a2fdd980-2eba-44af-b7c3-4882199a855f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:08.354775 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a2fdd980-2eba-44af-b7c3-4882199a855f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:08.355785 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a2fdd980-2eba-44af-b7c3-4882199a855f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:08.357522 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-c6282e2a-92ee-46ff-85e2-5fd2c7b699f5 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2" status: 200 len: 1314 microversion: 2.1 time: 0.560863 Jan 18 16:33:08.358545 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a2fdd980-2eba-44af-b7c3-4882199a855f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:08.371298 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 230/471] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:07 2022] GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2 => generated 1314 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:08.381938 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-04a2c1ab-c19c-4d56-82b7-77db700c6d6d tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:08.382902 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-04a2c1ab-c19c-4d56-82b7-77db700c6d6d tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:08.394139 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-04a2c1ab-c19c-4d56-82b7-77db700c6d6d tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:08.395142 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-04a2c1ab-c19c-4d56-82b7-77db700c6d6d tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:08.396247 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-04a2c1ab-c19c-4d56-82b7-77db700c6d6d tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:08.397064 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-04a2c1ab-c19c-4d56-82b7-77db700c6d6d tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:09.101471 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-a2fdd980-2eba-44af-b7c3-4882199a855f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:09.131590 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-a2fdd980-2eba-44af-b7c3-4882199a855f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:09.133993 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-a2fdd980-2eba-44af-b7c3-4882199a855f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:09.135735 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-a2fdd980-2eba-44af-b7c3-4882199a855f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1809 microversion: 2.20 time: 0.801424 Jan 18 16:33:09.138179 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 242/472] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:33:08 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1809 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:33:09.274975 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-04a2c1ab-c19c-4d56-82b7-77db700c6d6d tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0509d42df8844400b99d7c060ab98c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:09.308169 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-04a2c1ab-c19c-4d56-82b7-77db700c6d6d tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 200 len: 1358 microversion: 2.1 time: 0.934876 Jan 18 16:33:09.310758 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 231/473] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:08 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 1358 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:09.350818 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-6f214d4b-2ca6-44c7-ba9b-1336667f843d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:09.351551 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-6f214d4b-2ca6-44c7-ba9b-1336667f843d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:09.359802 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6f214d4b-2ca6-44c7-ba9b-1336667f843d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:09.377225 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-150160d5-50c5-4b4c-a055-cf5fc31fcbc6 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:09.378640 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-150160d5-50c5-4b4c-a055-cf5fc31fcbc6 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c2217c82-c31b-4997-a07b-a3f3b15120f2] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:09.388033 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6f214d4b-2ca6-44c7-ba9b-1336667f843d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:09.390716 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6f214d4b-2ca6-44c7-ba9b-1336667f843d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:09.393985 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6f214d4b-2ca6-44c7-ba9b-1336667f843d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:09.400021 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-150160d5-50c5-4b4c-a055-cf5fc31fcbc6 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:09.402018 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-150160d5-50c5-4b4c-a055-cf5fc31fcbc6 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:09.406859 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-150160d5-50c5-4b4c-a055-cf5fc31fcbc6 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:09.409183 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-150160d5-50c5-4b4c-a055-cf5fc31fcbc6 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:09.874095 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-150160d5-50c5-4b4c-a055-cf5fc31fcbc6 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9424067ecef94af9ae0828b77926f675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74e7f75a7c41be9e4e3f6884b4d832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:09.884072 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-150160d5-50c5-4b4c-a055-cf5fc31fcbc6 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2" status: 200 len: 1498 microversion: 2.1 time: 0.510520 Jan 18 16:33:09.887990 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 232/474] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:09 2022] GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2 => generated 1498 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:33:09.900386 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [req-ff451f7a-1683-4cfe-baf1-42ee5deb67a5 req-9d6802b1-fc3e-4334-a6c5-23478e56ead1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "218c4c12-4e16-4dc9-8519-bcef764f01c6", "tag": "684a69e2-8aee-429a-ad20-cba1e94ddb16"}]} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:33:09.911629 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:33:09.911629 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: warnings.warn(msg) Jan 18 16:33:09.925700 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-6f214d4b-2ca6-44c7-ba9b-1336667f843d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:09.941402 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-6f214d4b-2ca6-44c7-ba9b-1336667f843d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1506 microversion: 2.1 time: 0.593982 Jan 18 16:33:09.941983 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 243/475] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:09 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1506 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:09.956264 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-ff451f7a-1683-4cfe-baf1-42ee5deb67a5 req-9d6802b1-fc3e-4334-a6c5-23478e56ead1 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:09.958408 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-ff451f7a-1683-4cfe-baf1-42ee5deb67a5 req-9d6802b1-fc3e-4334-a6c5-23478e56ead1 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:09.977881 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.compute.server_external_events [req-ff451f7a-1683-4cfe-baf1-42ee5deb67a5 req-9d6802b1-fc3e-4334-a6c5-23478e56ead1 service nova] Creating event network-changed:684a69e2-8aee-429a-ad20-cba1e94ddb16 for instance 218c4c12-4e16-4dc9-8519-bcef764f01c6 on hv-cinder-78836 Jan 18 16:33:09.995578 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [req-ff451f7a-1683-4cfe-baf1-42ee5deb67a5 req-9d6802b1-fc3e-4334-a6c5-23478e56ead1 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105463 Jan 18 16:33:09.997442 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 233/476] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:33:10.155878 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-4f2d475c-496f-44c1-bf08-85d30af27554 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:10.156360 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-4f2d475c-496f-44c1-bf08-85d30af27554 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:10.164163 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4f2d475c-496f-44c1-bf08-85d30af27554 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:10.164610 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4f2d475c-496f-44c1-bf08-85d30af27554 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:10.173913 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4f2d475c-496f-44c1-bf08-85d30af27554 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:10.193031 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4f2d475c-496f-44c1-bf08-85d30af27554 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:10.328385 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-1bc4874d-3b9c-4af2-907e-635dd3f57b85 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:10.332064 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-1bc4874d-3b9c-4af2-907e-635dd3f57b85 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:10.351469 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1bc4874d-3b9c-4af2-907e-635dd3f57b85 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:10.352279 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1bc4874d-3b9c-4af2-907e-635dd3f57b85 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:10.355033 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1bc4874d-3b9c-4af2-907e-635dd3f57b85 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:10.357809 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1bc4874d-3b9c-4af2-907e-635dd3f57b85 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:10.770258 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-4f2d475c-496f-44c1-bf08-85d30af27554 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:10.786697 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-4f2d475c-496f-44c1-bf08-85d30af27554 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:10.799191 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-4f2d475c-496f-44c1-bf08-85d30af27554 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:10.804711 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-4f2d475c-496f-44c1-bf08-85d30af27554 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1809 microversion: 2.20 time: 0.652433 Jan 18 16:33:10.804950 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-1bc4874d-3b9c-4af2-907e-635dd3f57b85 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0509d42df8844400b99d7c060ab98c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:10.810744 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 244/477] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:33:10 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1809 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 16:33:10.827518 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-1bc4874d-3b9c-4af2-907e-635dd3f57b85 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 200 len: 1358 microversion: 2.1 time: 0.503758 Jan 18 16:33:10.828439 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 234/478] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:10 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 1358 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:10.831696 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-18e6afbb-74c2-4219-99cd-b53cbb0ebb3a tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:10.835281 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-18e6afbb-74c2-4219-99cd-b53cbb0ebb3a tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c2217c82-c31b-4997-a07b-a3f3b15120f2] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:10.862086 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-18e6afbb-74c2-4219-99cd-b53cbb0ebb3a tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:10.865323 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-18e6afbb-74c2-4219-99cd-b53cbb0ebb3a tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:10.867784 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-18e6afbb-74c2-4219-99cd-b53cbb0ebb3a tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:10.869335 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-18e6afbb-74c2-4219-99cd-b53cbb0ebb3a tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:10.943688 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-18e6afbb-74c2-4219-99cd-b53cbb0ebb3a tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c2217c82-c31b-4997-a07b-a3f3b15120f2] Going to try to terminate instance {{(pid=116367) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 18 16:33:10.967797 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-f85e8e23-0b58-42bf-8f4a-c17136f1d19f tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:10.969111 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-f85e8e23-0b58-42bf-8f4a-c17136f1d19f tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:10.981001 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f85e8e23-0b58-42bf-8f4a-c17136f1d19f tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:10.987770 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f85e8e23-0b58-42bf-8f4a-c17136f1d19f tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:10.991742 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f85e8e23-0b58-42bf-8f4a-c17136f1d19f tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:10.994366 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f85e8e23-0b58-42bf-8f4a-c17136f1d19f tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:11.167488 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-18e6afbb-74c2-4219-99cd-b53cbb0ebb3a tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "DELETE /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2" status: 204 len: 0 microversion: 2.1 time: 0.353916 Jan 18 16:33:11.171419 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 245/479] 10.222.0.82 () {58 vars in 1238 bytes} [Tue Jan 18 16:33:10 2022] DELETE /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 18 16:33:11.180280 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-6809721c-0c7e-4421-a3a8-e4b007fd003d tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:11.185812 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-6809721c-0c7e-4421-a3a8-e4b007fd003d tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c2217c82-c31b-4997-a07b-a3f3b15120f2] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:11.194604 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6809721c-0c7e-4421-a3a8-e4b007fd003d tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:11.195394 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6809721c-0c7e-4421-a3a8-e4b007fd003d tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:11.197090 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6809721c-0c7e-4421-a3a8-e4b007fd003d tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:11.199180 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6809721c-0c7e-4421-a3a8-e4b007fd003d tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:11.739109 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-f85e8e23-0b58-42bf-8f4a-c17136f1d19f tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:11.755660 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-f85e8e23-0b58-42bf-8f4a-c17136f1d19f tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1506 microversion: 2.1 time: 0.799937 Jan 18 16:33:11.757320 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 235/480] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:10 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1506 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:11.772785 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-6809721c-0c7e-4421-a3a8-e4b007fd003d tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9424067ecef94af9ae0828b77926f675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74e7f75a7c41be9e4e3f6884b4d832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:11.791186 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-6809721c-0c7e-4421-a3a8-e4b007fd003d tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2" status: 200 len: 1504 microversion: 2.1 time: 0.614999 Jan 18 16:33:11.791842 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 246/481] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:11 2022] GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2 => generated 1504 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:11.830473 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-475cec08-4b64-408b-92c4-0bf6b06d363d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:11.837796 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-475cec08-4b64-408b-92c4-0bf6b06d363d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:11.846329 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-fa1515c8-8855-41dc-b22a-f5c2b19e4b73 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:11.846949 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-fa1515c8-8855-41dc-b22a-f5c2b19e4b73 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:11.852462 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-475cec08-4b64-408b-92c4-0bf6b06d363d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:11.853156 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-475cec08-4b64-408b-92c4-0bf6b06d363d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:11.856497 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-fa1515c8-8855-41dc-b22a-f5c2b19e4b73 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:11.856890 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-fa1515c8-8855-41dc-b22a-f5c2b19e4b73 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:11.857712 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-fa1515c8-8855-41dc-b22a-f5c2b19e4b73 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:11.858056 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-475cec08-4b64-408b-92c4-0bf6b06d363d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:11.858169 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-fa1515c8-8855-41dc-b22a-f5c2b19e4b73 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:11.858914 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-475cec08-4b64-408b-92c4-0bf6b06d363d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:12.269907 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-475cec08-4b64-408b-92c4-0bf6b06d363d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:12.291931 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-475cec08-4b64-408b-92c4-0bf6b06d363d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:12.295559 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-475cec08-4b64-408b-92c4-0bf6b06d363d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:12.300342 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-475cec08-4b64-408b-92c4-0bf6b06d363d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1809 microversion: 2.20 time: 0.471657 Jan 18 16:33:12.302612 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 236/482] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:33:11 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1809 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:33:12.341310 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-fa1515c8-8855-41dc-b22a-f5c2b19e4b73 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0509d42df8844400b99d7c060ab98c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:12.351782 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-fa1515c8-8855-41dc-b22a-f5c2b19e4b73 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 200 len: 1358 microversion: 2.1 time: 0.509999 Jan 18 16:33:12.352355 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 247/483] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:11 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 1358 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:12.778477 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-4a7f1f2e-a89a-4fb3-be04-648f8b9840f1 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:12.779585 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-4a7f1f2e-a89a-4fb3-be04-648f8b9840f1 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:12.793451 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4a7f1f2e-a89a-4fb3-be04-648f8b9840f1 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:12.794353 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4a7f1f2e-a89a-4fb3-be04-648f8b9840f1 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:12.797142 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4a7f1f2e-a89a-4fb3-be04-648f8b9840f1 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:12.797475 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4a7f1f2e-a89a-4fb3-be04-648f8b9840f1 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:12.808230 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-e7c68aa9-d361-40b4-8954-860656c91594 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:12.809232 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-e7c68aa9-d361-40b4-8954-860656c91594 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c2217c82-c31b-4997-a07b-a3f3b15120f2] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:12.828396 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e7c68aa9-d361-40b4-8954-860656c91594 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:12.829686 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e7c68aa9-d361-40b4-8954-860656c91594 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:12.830976 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e7c68aa9-d361-40b4-8954-860656c91594 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:12.833740 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e7c68aa9-d361-40b4-8954-860656c91594 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:13.101247 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-4a7f1f2e-a89a-4fb3-be04-648f8b9840f1 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:13.108840 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-4a7f1f2e-a89a-4fb3-be04-648f8b9840f1 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1506 microversion: 2.1 time: 0.338068 Jan 18 16:33:13.115362 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 237/484] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:12 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1506 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:13.177086 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-e7c68aa9-d361-40b4-8954-860656c91594 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9424067ecef94af9ae0828b77926f675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74e7f75a7c41be9e4e3f6884b4d832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:13.187279 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-e7c68aa9-d361-40b4-8954-860656c91594 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2" status: 200 len: 1504 microversion: 2.1 time: 0.383473 Jan 18 16:33:13.187858 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 248/485] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:12 2022] GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2 => generated 1504 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:13.319857 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-f90019c2-16be-4379-ba1a-0335c492e260 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:13.320800 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-f90019c2-16be-4379-ba1a-0335c492e260 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:13.327845 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f90019c2-16be-4379-ba1a-0335c492e260 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:13.328324 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f90019c2-16be-4379-ba1a-0335c492e260 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:13.329221 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f90019c2-16be-4379-ba1a-0335c492e260 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:13.329660 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f90019c2-16be-4379-ba1a-0335c492e260 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:13.368856 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-6390c887-fd20-409a-b9a6-a1cdc44a1f33 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:13.370258 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-6390c887-fd20-409a-b9a6-a1cdc44a1f33 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:13.391701 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6390c887-fd20-409a-b9a6-a1cdc44a1f33 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:13.393136 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6390c887-fd20-409a-b9a6-a1cdc44a1f33 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:13.394429 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6390c887-fd20-409a-b9a6-a1cdc44a1f33 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:13.395240 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6390c887-fd20-409a-b9a6-a1cdc44a1f33 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:13.660689 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-f90019c2-16be-4379-ba1a-0335c492e260 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:13.676560 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-f90019c2-16be-4379-ba1a-0335c492e260 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:13.678107 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-f90019c2-16be-4379-ba1a-0335c492e260 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:13.679317 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-f90019c2-16be-4379-ba1a-0335c492e260 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1809 microversion: 2.20 time: 0.363841 Jan 18 16:33:13.688141 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-6390c887-fd20-409a-b9a6-a1cdc44a1f33 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0509d42df8844400b99d7c060ab98c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:13.700635 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 238/486] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:33:13 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1809 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:33:13.712450 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-6390c887-fd20-409a-b9a6-a1cdc44a1f33 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 200 len: 1358 microversion: 2.1 time: 0.346903 Jan 18 16:33:13.722906 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 249/487] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:13 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 1358 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:33:14.135894 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-16618b8e-654b-4938-879c-94cc83fcb04d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:14.137248 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-16618b8e-654b-4938-879c-94cc83fcb04d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:14.149919 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-16618b8e-654b-4938-879c-94cc83fcb04d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:14.150402 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-16618b8e-654b-4938-879c-94cc83fcb04d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:14.151219 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-16618b8e-654b-4938-879c-94cc83fcb04d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:14.151654 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-16618b8e-654b-4938-879c-94cc83fcb04d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:14.207630 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-52a224e3-bacb-4934-8352-3447b336f7f7 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:14.208162 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-52a224e3-bacb-4934-8352-3447b336f7f7 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c2217c82-c31b-4997-a07b-a3f3b15120f2] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:14.215329 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-52a224e3-bacb-4934-8352-3447b336f7f7 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:14.216050 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-52a224e3-bacb-4934-8352-3447b336f7f7 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:14.217055 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-52a224e3-bacb-4934-8352-3447b336f7f7 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:14.217666 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-52a224e3-bacb-4934-8352-3447b336f7f7 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:14.436371 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-16618b8e-654b-4938-879c-94cc83fcb04d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:14.445201 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-16618b8e-654b-4938-879c-94cc83fcb04d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1506 microversion: 2.1 time: 0.316454 Jan 18 16:33:14.448581 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 239/488] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:14 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1506 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:14.614620 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-52a224e3-bacb-4934-8352-3447b336f7f7 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9424067ecef94af9ae0828b77926f675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74e7f75a7c41be9e4e3f6884b4d832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:14.623146 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-52a224e3-bacb-4934-8352-3447b336f7f7 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2" status: 200 len: 1504 microversion: 2.1 time: 0.420502 Jan 18 16:33:14.626633 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 250/489] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:14 2022] GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2 => generated 1504 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:33:14.698852 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-0e52e4d3-eff6-4f22-bb63-c910adee4aac tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:14.699864 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-0e52e4d3-eff6-4f22-bb63-c910adee4aac tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:14.713194 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0e52e4d3-eff6-4f22-bb63-c910adee4aac tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:14.713913 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0e52e4d3-eff6-4f22-bb63-c910adee4aac tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:14.714867 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0e52e4d3-eff6-4f22-bb63-c910adee4aac tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:14.716146 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0e52e4d3-eff6-4f22-bb63-c910adee4aac tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:14.740186 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-16b07aaf-2462-455e-8b5e-b42cb6755dfa tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:14.741393 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-16b07aaf-2462-455e-8b5e-b42cb6755dfa tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:14.750925 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-16b07aaf-2462-455e-8b5e-b42cb6755dfa tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:14.751838 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-16b07aaf-2462-455e-8b5e-b42cb6755dfa tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:14.754386 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-16b07aaf-2462-455e-8b5e-b42cb6755dfa tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:14.757480 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-16b07aaf-2462-455e-8b5e-b42cb6755dfa tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:15.127671 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-0e52e4d3-eff6-4f22-bb63-c910adee4aac tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:15.139158 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-0e52e4d3-eff6-4f22-bb63-c910adee4aac tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:15.140635 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-0e52e4d3-eff6-4f22-bb63-c910adee4aac tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:15.142044 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-0e52e4d3-eff6-4f22-bb63-c910adee4aac tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1809 microversion: 2.20 time: 0.447271 Jan 18 16:33:15.150542 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 240/490] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:33:14 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1809 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:33:15.186344 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-16b07aaf-2462-455e-8b5e-b42cb6755dfa tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0509d42df8844400b99d7c060ab98c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:15.213156 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-16b07aaf-2462-455e-8b5e-b42cb6755dfa tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 200 len: 1358 microversion: 2.1 time: 0.486466 Jan 18 16:33:15.215313 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 251/491] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:14 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 1358 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:15.467962 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-5d38f1d3-79f6-4770-be98-a972242a5a97 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:15.473707 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-5d38f1d3-79f6-4770-be98-a972242a5a97 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:15.485648 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-5d38f1d3-79f6-4770-be98-a972242a5a97 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:15.487424 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-5d38f1d3-79f6-4770-be98-a972242a5a97 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:15.488740 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-5d38f1d3-79f6-4770-be98-a972242a5a97 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:15.489829 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-5d38f1d3-79f6-4770-be98-a972242a5a97 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:15.644812 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-66020a00-a782-4ba1-b35b-c0c5b41e26ce tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:15.646387 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-66020a00-a782-4ba1-b35b-c0c5b41e26ce tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c2217c82-c31b-4997-a07b-a3f3b15120f2] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:15.663248 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-66020a00-a782-4ba1-b35b-c0c5b41e26ce tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:15.663969 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-66020a00-a782-4ba1-b35b-c0c5b41e26ce tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:15.664980 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-66020a00-a782-4ba1-b35b-c0c5b41e26ce tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:15.665572 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-66020a00-a782-4ba1-b35b-c0c5b41e26ce tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:15.693756 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-5d38f1d3-79f6-4770-be98-a972242a5a97 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:15.702177 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-5d38f1d3-79f6-4770-be98-a972242a5a97 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1506 microversion: 2.1 time: 0.243405 Jan 18 16:33:15.712389 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 241/492] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:15 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1506 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:15.847347 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-66020a00-a782-4ba1-b35b-c0c5b41e26ce tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9424067ecef94af9ae0828b77926f675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74e7f75a7c41be9e4e3f6884b4d832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:15.854944 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-66020a00-a782-4ba1-b35b-c0c5b41e26ce tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2" status: 200 len: 1504 microversion: 2.1 time: 0.215815 Jan 18 16:33:15.855808 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 252/493] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:15 2022] GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2 => generated 1504 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:33:16.161247 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-0f258283-e33e-4ea5-8891-7cb0036c4d3b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:16.172454 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-0f258283-e33e-4ea5-8891-7cb0036c4d3b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:16.190657 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0f258283-e33e-4ea5-8891-7cb0036c4d3b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:16.192641 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0f258283-e33e-4ea5-8891-7cb0036c4d3b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:16.195580 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0f258283-e33e-4ea5-8891-7cb0036c4d3b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:16.196284 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0f258283-e33e-4ea5-8891-7cb0036c4d3b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:16.231106 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-980814b1-dda1-4d02-bcf3-e65463875f35 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:16.232007 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-980814b1-dda1-4d02-bcf3-e65463875f35 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:16.243343 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-980814b1-dda1-4d02-bcf3-e65463875f35 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:16.243812 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-980814b1-dda1-4d02-bcf3-e65463875f35 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:16.244606 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-980814b1-dda1-4d02-bcf3-e65463875f35 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:16.245246 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-980814b1-dda1-4d02-bcf3-e65463875f35 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:16.567649 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-0f258283-e33e-4ea5-8891-7cb0036c4d3b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:16.581043 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-0f258283-e33e-4ea5-8891-7cb0036c4d3b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:16.582790 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-0f258283-e33e-4ea5-8891-7cb0036c4d3b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:16.584243 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-0f258283-e33e-4ea5-8891-7cb0036c4d3b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1809 microversion: 2.20 time: 0.426674 Jan 18 16:33:16.587723 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-980814b1-dda1-4d02-bcf3-e65463875f35 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0509d42df8844400b99d7c060ab98c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:16.589258 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 242/494] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:33:16 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1809 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:33:16.606925 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-980814b1-dda1-4d02-bcf3-e65463875f35 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 200 len: 1358 microversion: 2.1 time: 0.380138 Jan 18 16:33:16.611251 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 253/495] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:16 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 1358 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:33:16.720247 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-0f9ea8e6-819b-43da-864b-f78953f0c662 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:16.721519 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-0f9ea8e6-819b-43da-864b-f78953f0c662 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:16.730939 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0f9ea8e6-819b-43da-864b-f78953f0c662 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:16.734354 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0f9ea8e6-819b-43da-864b-f78953f0c662 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:16.740005 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0f9ea8e6-819b-43da-864b-f78953f0c662 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:16.740705 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0f9ea8e6-819b-43da-864b-f78953f0c662 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:16.873081 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-47bae7a0-ff96-4446-adc5-c88d3c2072ce tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:16.874530 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-47bae7a0-ff96-4446-adc5-c88d3c2072ce tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c2217c82-c31b-4997-a07b-a3f3b15120f2] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:16.888047 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-47bae7a0-ff96-4446-adc5-c88d3c2072ce tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:16.888660 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-47bae7a0-ff96-4446-adc5-c88d3c2072ce tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:16.889602 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-47bae7a0-ff96-4446-adc5-c88d3c2072ce tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:16.892231 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-47bae7a0-ff96-4446-adc5-c88d3c2072ce tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:16.944164 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-0f9ea8e6-819b-43da-864b-f78953f0c662 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:16.958178 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-0f9ea8e6-819b-43da-864b-f78953f0c662 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1506 microversion: 2.1 time: 0.242304 Jan 18 16:33:16.968911 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 243/496] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:16 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1506 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:17.138025 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-47bae7a0-ff96-4446-adc5-c88d3c2072ce tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9424067ecef94af9ae0828b77926f675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74e7f75a7c41be9e4e3f6884b4d832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:17.147415 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-47bae7a0-ff96-4446-adc5-c88d3c2072ce tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2" status: 200 len: 1504 microversion: 2.1 time: 0.277909 Jan 18 16:33:17.148025 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 254/497] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:16 2022] GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2 => generated 1504 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:17.613294 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-d457aed0-6f47-4d2d-9e39-665e9d289560 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:17.614906 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-d457aed0-6f47-4d2d-9e39-665e9d289560 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:17.630229 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-cd1d2561-dfba-4bbf-a5a4-160f036fd9c8 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:17.630847 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-cd1d2561-dfba-4bbf-a5a4-160f036fd9c8 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:17.643258 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d457aed0-6f47-4d2d-9e39-665e9d289560 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:17.643640 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d457aed0-6f47-4d2d-9e39-665e9d289560 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:17.648143 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-cd1d2561-dfba-4bbf-a5a4-160f036fd9c8 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:17.652912 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-cd1d2561-dfba-4bbf-a5a4-160f036fd9c8 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:17.653264 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d457aed0-6f47-4d2d-9e39-665e9d289560 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:17.653670 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d457aed0-6f47-4d2d-9e39-665e9d289560 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:17.656721 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-cd1d2561-dfba-4bbf-a5a4-160f036fd9c8 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:17.657486 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-cd1d2561-dfba-4bbf-a5a4-160f036fd9c8 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:18.078373 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-d457aed0-6f47-4d2d-9e39-665e9d289560 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:18.091197 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-d457aed0-6f47-4d2d-9e39-665e9d289560 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:18.095164 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-d457aed0-6f47-4d2d-9e39-665e9d289560 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:18.097818 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-d457aed0-6f47-4d2d-9e39-665e9d289560 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1809 microversion: 2.20 time: 0.492332 Jan 18 16:33:18.101470 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 244/498] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:33:17 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1809 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 16:33:18.106151 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-680788c1-71b5-4554-8654-9e4d65c6e73c tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:18.106741 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-680788c1-71b5-4554-8654-9e4d65c6e73c tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:18.124893 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-680788c1-71b5-4554-8654-9e4d65c6e73c tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:18.133010 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-680788c1-71b5-4554-8654-9e4d65c6e73c tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:18.134041 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-680788c1-71b5-4554-8654-9e4d65c6e73c tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:18.134481 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-680788c1-71b5-4554-8654-9e4d65c6e73c tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:18.166150 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-cd1d2561-dfba-4bbf-a5a4-160f036fd9c8 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0509d42df8844400b99d7c060ab98c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:18.176794 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-cd1d2561-dfba-4bbf-a5a4-160f036fd9c8 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 200 len: 1358 microversion: 2.1 time: 0.550620 Jan 18 16:33:18.177782 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 255/499] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:17 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 1358 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:18.183067 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-379b90b6-0b9e-4129-a7bd-037df558f8a8 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:18.183860 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-379b90b6-0b9e-4129-a7bd-037df558f8a8 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c2217c82-c31b-4997-a07b-a3f3b15120f2] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:18.215890 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-379b90b6-0b9e-4129-a7bd-037df558f8a8 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:18.217531 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-379b90b6-0b9e-4129-a7bd-037df558f8a8 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:18.220210 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-379b90b6-0b9e-4129-a7bd-037df558f8a8 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:18.221674 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-379b90b6-0b9e-4129-a7bd-037df558f8a8 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:18.452640 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-680788c1-71b5-4554-8654-9e4d65c6e73c tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:18.475203 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-680788c1-71b5-4554-8654-9e4d65c6e73c tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1506 microversion: 2.1 time: 0.372286 Jan 18 16:33:18.478362 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 245/500] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:18 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1506 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:18.640045 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-379b90b6-0b9e-4129-a7bd-037df558f8a8 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9424067ecef94af9ae0828b77926f675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74e7f75a7c41be9e4e3f6884b4d832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:18.651310 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-379b90b6-0b9e-4129-a7bd-037df558f8a8 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2" status: 200 len: 1504 microversion: 2.1 time: 0.471798 Jan 18 16:33:18.652594 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 256/501] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:18 2022] GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2 => generated 1504 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:19.117685 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-18eb4c6e-5da0-42d2-85b5-f8e6a11e23aa tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:19.118295 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-18eb4c6e-5da0-42d2-85b5-f8e6a11e23aa tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:19.136631 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-18eb4c6e-5da0-42d2-85b5-f8e6a11e23aa tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:19.137504 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-18eb4c6e-5da0-42d2-85b5-f8e6a11e23aa tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:19.138536 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-18eb4c6e-5da0-42d2-85b5-f8e6a11e23aa tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:19.139179 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-18eb4c6e-5da0-42d2-85b5-f8e6a11e23aa tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:19.194702 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-818497c5-9317-4889-81a0-9794e8916d3c tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:19.197390 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-818497c5-9317-4889-81a0-9794e8916d3c tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:19.210983 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-818497c5-9317-4889-81a0-9794e8916d3c tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:19.211691 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-818497c5-9317-4889-81a0-9794e8916d3c tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:19.212727 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-818497c5-9317-4889-81a0-9794e8916d3c tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:19.221698 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-818497c5-9317-4889-81a0-9794e8916d3c tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:19.642089 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-18eb4c6e-5da0-42d2-85b5-f8e6a11e23aa tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:19.672256 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-18eb4c6e-5da0-42d2-85b5-f8e6a11e23aa tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:19.679093 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-18eb4c6e-5da0-42d2-85b5-f8e6a11e23aa tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:19.682609 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-18eb4c6e-5da0-42d2-85b5-f8e6a11e23aa tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1809 microversion: 2.20 time: 0.568692 Jan 18 16:33:19.686116 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 246/502] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:33:19 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1809 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:33:19.714372 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-515a15e0-5c65-4dda-8148-8887adb885cf tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:19.718458 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-515a15e0-5c65-4dda-8148-8887adb885cf tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:19.736479 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-515a15e0-5c65-4dda-8148-8887adb885cf tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:19.737480 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-515a15e0-5c65-4dda-8148-8887adb885cf tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:19.740046 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-515a15e0-5c65-4dda-8148-8887adb885cf tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:19.741562 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-515a15e0-5c65-4dda-8148-8887adb885cf tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:19.767831 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-818497c5-9317-4889-81a0-9794e8916d3c tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0509d42df8844400b99d7c060ab98c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:19.775927 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-818497c5-9317-4889-81a0-9794e8916d3c tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 200 len: 1358 microversion: 2.1 time: 0.585209 Jan 18 16:33:19.789328 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 257/503] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:19 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 1358 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:33:19.808875 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-f3646993-fed1-4c2f-8b0a-e9a3d5413884 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:19.809784 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-f3646993-fed1-4c2f-8b0a-e9a3d5413884 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c2217c82-c31b-4997-a07b-a3f3b15120f2] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:19.835728 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-f3646993-fed1-4c2f-8b0a-e9a3d5413884 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:19.836367 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-f3646993-fed1-4c2f-8b0a-e9a3d5413884 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:19.837471 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-f3646993-fed1-4c2f-8b0a-e9a3d5413884 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:19.844666 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-f3646993-fed1-4c2f-8b0a-e9a3d5413884 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:20.232396 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-f3646993-fed1-4c2f-8b0a-e9a3d5413884 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9424067ecef94af9ae0828b77926f675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74e7f75a7c41be9e4e3f6884b4d832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:20.243860 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-f3646993-fed1-4c2f-8b0a-e9a3d5413884 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2" status: 200 len: 1504 microversion: 2.1 time: 0.452369 Jan 18 16:33:20.244715 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 258/504] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:19 2022] GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2 => generated 1504 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:20.273060 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-515a15e0-5c65-4dda-8148-8887adb885cf tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:20.285111 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-515a15e0-5c65-4dda-8148-8887adb885cf tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1506 microversion: 2.1 time: 0.583797 Jan 18 16:33:20.285989 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 247/505] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:19 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1506 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:20.708076 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-a5ddf51e-20d7-48f1-ba35-b736759ecdbc tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:20.708695 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-a5ddf51e-20d7-48f1-ba35-b736759ecdbc tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:20.720588 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a5ddf51e-20d7-48f1-ba35-b736759ecdbc tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:20.721334 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a5ddf51e-20d7-48f1-ba35-b736759ecdbc tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:20.722338 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a5ddf51e-20d7-48f1-ba35-b736759ecdbc tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:20.722934 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a5ddf51e-20d7-48f1-ba35-b736759ecdbc tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:20.798717 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-d05d076d-c5ff-4cfb-9151-ae0d7940a980 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:20.800201 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-d05d076d-c5ff-4cfb-9151-ae0d7940a980 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:20.820279 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d05d076d-c5ff-4cfb-9151-ae0d7940a980 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:20.823285 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d05d076d-c5ff-4cfb-9151-ae0d7940a980 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:20.824354 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d05d076d-c5ff-4cfb-9151-ae0d7940a980 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:20.825676 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d05d076d-c5ff-4cfb-9151-ae0d7940a980 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:21.192844 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-a5ddf51e-20d7-48f1-ba35-b736759ecdbc tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:21.209944 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-a5ddf51e-20d7-48f1-ba35-b736759ecdbc tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:21.213793 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-a5ddf51e-20d7-48f1-ba35-b736759ecdbc tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:21.215325 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-a5ddf51e-20d7-48f1-ba35-b736759ecdbc tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1809 microversion: 2.20 time: 0.511842 Jan 18 16:33:21.216720 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 259/506] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:33:20 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1809 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 16:33:21.229307 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-d05d076d-c5ff-4cfb-9151-ae0d7940a980 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0509d42df8844400b99d7c060ab98c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:21.237808 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-d05d076d-c5ff-4cfb-9151-ae0d7940a980 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 200 len: 1358 microversion: 2.1 time: 0.447998 Jan 18 16:33:21.242439 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 248/507] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:20 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 1358 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:21.262641 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-016ef6b4-9a16-4f7a-8217-6840e8ce3e99 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:21.263255 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-016ef6b4-9a16-4f7a-8217-6840e8ce3e99 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c2217c82-c31b-4997-a07b-a3f3b15120f2] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:21.280597 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-016ef6b4-9a16-4f7a-8217-6840e8ce3e99 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:21.289699 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-016ef6b4-9a16-4f7a-8217-6840e8ce3e99 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:21.290823 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-016ef6b4-9a16-4f7a-8217-6840e8ce3e99 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:21.291462 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-016ef6b4-9a16-4f7a-8217-6840e8ce3e99 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:21.302500 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-9dd222a7-f791-4196-92f0-6e70897ca010 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:21.309223 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-9dd222a7-f791-4196-92f0-6e70897ca010 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:21.316837 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-9dd222a7-f791-4196-92f0-6e70897ca010 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:21.317633 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-9dd222a7-f791-4196-92f0-6e70897ca010 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:21.318657 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-9dd222a7-f791-4196-92f0-6e70897ca010 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:21.324879 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-9dd222a7-f791-4196-92f0-6e70897ca010 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:21.888049 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-016ef6b4-9a16-4f7a-8217-6840e8ce3e99 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9424067ecef94af9ae0828b77926f675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74e7f75a7c41be9e4e3f6884b4d832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:21.916533 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-016ef6b4-9a16-4f7a-8217-6840e8ce3e99 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2" status: 200 len: 1504 microversion: 2.1 time: 0.657993 Jan 18 16:33:21.919792 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 260/508] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:21 2022] GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2 => generated 1504 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:21.926811 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-9dd222a7-f791-4196-92f0-6e70897ca010 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:21.936225 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-9dd222a7-f791-4196-92f0-6e70897ca010 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1506 microversion: 2.1 time: 0.637391 Jan 18 16:33:21.946957 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 249/509] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:21 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1506 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:22.236747 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-28ba3539-9ee0-43a8-8d48-5fe92c86ca61 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:22.237238 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-28ba3539-9ee0-43a8-8d48-5fe92c86ca61 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:22.260475 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-92ddd334-013f-401e-80a8-3e80c1b60c34 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:22.261922 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-92ddd334-013f-401e-80a8-3e80c1b60c34 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:22.281288 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-92ddd334-013f-401e-80a8-3e80c1b60c34 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:22.285488 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-28ba3539-9ee0-43a8-8d48-5fe92c86ca61 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:22.286306 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-92ddd334-013f-401e-80a8-3e80c1b60c34 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:22.288598 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-28ba3539-9ee0-43a8-8d48-5fe92c86ca61 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:22.289708 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-92ddd334-013f-401e-80a8-3e80c1b60c34 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:22.292085 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-92ddd334-013f-401e-80a8-3e80c1b60c34 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:22.292340 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-28ba3539-9ee0-43a8-8d48-5fe92c86ca61 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:22.292897 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-28ba3539-9ee0-43a8-8d48-5fe92c86ca61 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:22.817893 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-28ba3539-9ee0-43a8-8d48-5fe92c86ca61 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:22.833179 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-28ba3539-9ee0-43a8-8d48-5fe92c86ca61 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:22.835864 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-28ba3539-9ee0-43a8-8d48-5fe92c86ca61 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:22.839610 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-28ba3539-9ee0-43a8-8d48-5fe92c86ca61 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1809 microversion: 2.20 time: 0.607613 Jan 18 16:33:22.853748 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 261/510] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:33:22 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1809 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:33:22.902381 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-92ddd334-013f-401e-80a8-3e80c1b60c34 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0509d42df8844400b99d7c060ab98c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:22.911123 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-92ddd334-013f-401e-80a8-3e80c1b60c34 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 200 len: 1358 microversion: 2.1 time: 0.655359 Jan 18 16:33:22.919884 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 250/511] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:22 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 1358 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:22.937203 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-3d12966d-02c4-40f0-92cf-259c659a2240 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:22.938052 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-3d12966d-02c4-40f0-92cf-259c659a2240 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c2217c82-c31b-4997-a07b-a3f3b15120f2] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:22.960289 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-3d12966d-02c4-40f0-92cf-259c659a2240 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:22.961145 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-5b459f02-a141-4ae3-b973-652220acea20 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:22.963668 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-3d12966d-02c4-40f0-92cf-259c659a2240 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:22.965772 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-5b459f02-a141-4ae3-b973-652220acea20 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:22.968837 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-3d12966d-02c4-40f0-92cf-259c659a2240 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:22.971735 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-3d12966d-02c4-40f0-92cf-259c659a2240 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:22.986388 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-5b459f02-a141-4ae3-b973-652220acea20 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:22.986843 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-5b459f02-a141-4ae3-b973-652220acea20 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:22.987651 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-5b459f02-a141-4ae3-b973-652220acea20 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:22.988084 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-5b459f02-a141-4ae3-b973-652220acea20 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:23.379539 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-5b459f02-a141-4ae3-b973-652220acea20 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:23.387883 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-5b459f02-a141-4ae3-b973-652220acea20 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1506 microversion: 2.1 time: 0.437644 Jan 18 16:33:23.410210 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 251/512] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:22 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1506 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:33:23.458190 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-3d12966d-02c4-40f0-92cf-259c659a2240 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9424067ecef94af9ae0828b77926f675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74e7f75a7c41be9e4e3f6884b4d832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:23.466832 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-3d12966d-02c4-40f0-92cf-259c659a2240 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2" status: 200 len: 1504 microversion: 2.1 time: 0.533936 Jan 18 16:33:23.472578 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 262/513] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:22 2022] GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2 => generated 1504 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:23.862736 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-f7eb808f-b50d-41a3-adc6-5f1acb082b50 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:23.863365 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-f7eb808f-b50d-41a3-adc6-5f1acb082b50 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:23.875268 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f7eb808f-b50d-41a3-adc6-5f1acb082b50 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:23.881315 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f7eb808f-b50d-41a3-adc6-5f1acb082b50 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:23.882697 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f7eb808f-b50d-41a3-adc6-5f1acb082b50 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:23.883316 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f7eb808f-b50d-41a3-adc6-5f1acb082b50 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:23.937226 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-956760ea-2738-44fa-a0f2-d21f6265e0bc tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:23.938732 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-956760ea-2738-44fa-a0f2-d21f6265e0bc tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:23.950686 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-956760ea-2738-44fa-a0f2-d21f6265e0bc tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:23.957898 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-956760ea-2738-44fa-a0f2-d21f6265e0bc tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:23.959011 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-956760ea-2738-44fa-a0f2-d21f6265e0bc tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:23.959594 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-956760ea-2738-44fa-a0f2-d21f6265e0bc tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:24.160382 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-f7eb808f-b50d-41a3-adc6-5f1acb082b50 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:24.174439 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-f7eb808f-b50d-41a3-adc6-5f1acb082b50 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:24.175121 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-f7eb808f-b50d-41a3-adc6-5f1acb082b50 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:24.176370 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-f7eb808f-b50d-41a3-adc6-5f1acb082b50 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1809 microversion: 2.20 time: 0.318514 Jan 18 16:33:24.179229 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 252/514] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:33:23 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1809 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:33:24.327056 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-956760ea-2738-44fa-a0f2-d21f6265e0bc tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0509d42df8844400b99d7c060ab98c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:24.335600 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-956760ea-2738-44fa-a0f2-d21f6265e0bc tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 200 len: 1358 microversion: 2.1 time: 0.401984 Jan 18 16:33:24.337866 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 263/515] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:23 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 1358 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:24.418102 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-01f1f5a6-8ce6-4070-8482-234da85a257d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:24.418798 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-01f1f5a6-8ce6-4070-8482-234da85a257d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:24.431571 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-01f1f5a6-8ce6-4070-8482-234da85a257d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:24.432245 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-01f1f5a6-8ce6-4070-8482-234da85a257d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:24.438628 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-01f1f5a6-8ce6-4070-8482-234da85a257d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:24.439156 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-01f1f5a6-8ce6-4070-8482-234da85a257d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:24.490201 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-84afbd43-9312-4608-b956-fae07a0558e2 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:24.490943 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-84afbd43-9312-4608-b956-fae07a0558e2 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c2217c82-c31b-4997-a07b-a3f3b15120f2] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:24.505233 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-84afbd43-9312-4608-b956-fae07a0558e2 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:24.505963 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-84afbd43-9312-4608-b956-fae07a0558e2 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:24.509278 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-84afbd43-9312-4608-b956-fae07a0558e2 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:24.512080 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-84afbd43-9312-4608-b956-fae07a0558e2 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:24.850624 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-01f1f5a6-8ce6-4070-8482-234da85a257d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:24.860266 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-01f1f5a6-8ce6-4070-8482-234da85a257d tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1506 microversion: 2.1 time: 0.449728 Jan 18 16:33:24.861043 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 253/516] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:24 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1506 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:24.870169 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-84afbd43-9312-4608-b956-fae07a0558e2 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9424067ecef94af9ae0828b77926f675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74e7f75a7c41be9e4e3f6884b4d832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:24.880248 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-84afbd43-9312-4608-b956-fae07a0558e2 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2" status: 200 len: 1504 microversion: 2.1 time: 0.396450 Jan 18 16:33:24.893693 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 264/517] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:24 2022] GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2 => generated 1504 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:33:25.197051 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-7968e756-6057-4df3-b18d-c4dccac50b74 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:25.197792 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-7968e756-6057-4df3-b18d-c4dccac50b74 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:25.204309 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7968e756-6057-4df3-b18d-c4dccac50b74 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:25.204555 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7968e756-6057-4df3-b18d-c4dccac50b74 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:25.205539 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7968e756-6057-4df3-b18d-c4dccac50b74 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:25.206130 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7968e756-6057-4df3-b18d-c4dccac50b74 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:25.382257 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-7968e756-6057-4df3-b18d-c4dccac50b74 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:25.392764 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-7968e756-6057-4df3-b18d-c4dccac50b74 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:25.394348 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-7968e756-6057-4df3-b18d-c4dccac50b74 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:25.395511 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-7968e756-6057-4df3-b18d-c4dccac50b74 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1809 microversion: 2.20 time: 0.202239 Jan 18 16:33:25.396079 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 265/518] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:33:25 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1809 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 16:33:25.410273 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-b0141043-8fc9-40ec-a645-4d5d3f7b9cac tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:25.410901 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-b0141043-8fc9-40ec-a645-4d5d3f7b9cac tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:25.417142 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-b0141043-8fc9-40ec-a645-4d5d3f7b9cac tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:25.417613 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-b0141043-8fc9-40ec-a645-4d5d3f7b9cac tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:25.418542 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-b0141043-8fc9-40ec-a645-4d5d3f7b9cac tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:25.419173 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-b0141043-8fc9-40ec-a645-4d5d3f7b9cac tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:25.428988 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-87172b73-c467-4f37-95c2-e2691da431f8 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Action: 'create', calling method: .version_select at 0x7f33a4aeba60>, body: {"keypair": {"name": "tempest-TestShelveInstance-248830851"}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:33:25.449205 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.quota [None req-87172b73-c467-4f37-95c2-e2691da431f8 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Getting quotas for project 726b7bab53ef4d6e869362551b3cfb6c. Resources: {'key_pairs'} {{(pid=116368) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 16:33:25.454780 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.quota [None req-87172b73-c467-4f37-95c2-e2691da431f8 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Getting quotas for user 8a2d1245fe3f4bf596e1c0f6978e34bd and project 726b7bab53ef4d6e869362551b3cfb6c. Resources: {'key_pairs'} {{(pid=116368) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 16:33:25.620953 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-b0141043-8fc9-40ec-a645-4d5d3f7b9cac tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0509d42df8844400b99d7c060ab98c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:25.637448 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-b0141043-8fc9-40ec-a645-4d5d3f7b9cac tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 200 len: 1358 microversion: 2.1 time: 0.240275 Jan 18 16:33:25.638406 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 266/519] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:25 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 1358 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:25.878156 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-80e6bf39-03cb-4263-8e9f-f7a833294fe6 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:25.878763 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-80e6bf39-03cb-4263-8e9f-f7a833294fe6 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:25.898654 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-80e6bf39-03cb-4263-8e9f-f7a833294fe6 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:25.899437 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-80e6bf39-03cb-4263-8e9f-f7a833294fe6 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:25.900471 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-80e6bf39-03cb-4263-8e9f-f7a833294fe6 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:25.901197 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-80e6bf39-03cb-4263-8e9f-f7a833294fe6 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:25.960280 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.quota [None req-87172b73-c467-4f37-95c2-e2691da431f8 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Getting quotas for project 726b7bab53ef4d6e869362551b3cfb6c. Resources: {'key_pairs'} {{(pid=116368) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 16:33:25.966750 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.quota [None req-87172b73-c467-4f37-95c2-e2691da431f8 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Getting quotas for user 8a2d1245fe3f4bf596e1c0f6978e34bd and project 726b7bab53ef4d6e869362551b3cfb6c. Resources: {'key_pairs'} {{(pid=116368) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 16:33:25.994685 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-87172b73-c467-4f37-95c2-e2691da431f8 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 200 len: 2311 microversion: 2.1 time: 0.816969 Jan 18 16:33:25.995932 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 254/520] 10.222.0.82 () {60 vars in 1157 bytes} [Tue Jan 18 16:33:25 2022] POST /compute/v2.1/os-keypairs => generated 2311 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:26.011968 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-790beaaf-6d9e-429c-9205-132171eeb4aa tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:26.012852 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-790beaaf-6d9e-429c-9205-132171eeb4aa tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c2217c82-c31b-4997-a07b-a3f3b15120f2] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:26.025048 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-790beaaf-6d9e-429c-9205-132171eeb4aa tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:26.025773 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-790beaaf-6d9e-429c-9205-132171eeb4aa tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:26.026724 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-790beaaf-6d9e-429c-9205-132171eeb4aa tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:26.029515 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-790beaaf-6d9e-429c-9205-132171eeb4aa tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:26.247310 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-80e6bf39-03cb-4263-8e9f-f7a833294fe6 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:26.266613 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-80e6bf39-03cb-4263-8e9f-f7a833294fe6 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1506 microversion: 2.1 time: 0.391517 Jan 18 16:33:26.270014 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 267/521] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:25 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1506 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:26.391179 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-790beaaf-6d9e-429c-9205-132171eeb4aa tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9424067ecef94af9ae0828b77926f675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74e7f75a7c41be9e4e3f6884b4d832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:26.402029 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-790beaaf-6d9e-429c-9205-132171eeb4aa tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2" status: 200 len: 1504 microversion: 2.1 time: 0.404871 Jan 18 16:33:26.402750 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 255/522] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:25 2022] GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2 => generated 1504 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:26.419730 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-7e62ee27-7125-4815-a75c-55e11b881c0c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:26.420678 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-7e62ee27-7125-4815-a75c-55e11b881c0c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:26.429618 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7e62ee27-7125-4815-a75c-55e11b881c0c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:26.430336 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7e62ee27-7125-4815-a75c-55e11b881c0c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:26.431294 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7e62ee27-7125-4815-a75c-55e11b881c0c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:26.431880 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7e62ee27-7125-4815-a75c-55e11b881c0c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:26.655616 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-5b0a0f0c-b1f5-4adb-b8cc-8342601a9af9 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:26.661843 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-5b0a0f0c-b1f5-4adb-b8cc-8342601a9af9 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:26.670232 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-5b0a0f0c-b1f5-4adb-b8cc-8342601a9af9 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:26.672802 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-5b0a0f0c-b1f5-4adb-b8cc-8342601a9af9 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:26.673845 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-5b0a0f0c-b1f5-4adb-b8cc-8342601a9af9 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:26.676618 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-5b0a0f0c-b1f5-4adb-b8cc-8342601a9af9 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:26.681570 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-7e62ee27-7125-4815-a75c-55e11b881c0c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:26.692300 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-7e62ee27-7125-4815-a75c-55e11b881c0c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:26.693811 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-7e62ee27-7125-4815-a75c-55e11b881c0c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:26.694977 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-7e62ee27-7125-4815-a75c-55e11b881c0c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1809 microversion: 2.20 time: 0.280788 Jan 18 16:33:26.706974 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 268/523] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:33:26 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1809 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:33:26.926251 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-5b0a0f0c-b1f5-4adb-b8cc-8342601a9af9 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0509d42df8844400b99d7c060ab98c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:26.941679 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-5b0a0f0c-b1f5-4adb-b8cc-8342601a9af9 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 200 len: 1358 microversion: 2.1 time: 0.290263 Jan 18 16:33:26.942285 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 256/524] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:26 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 1358 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:33:27.288747 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-d84efcc5-71e9-4b64-979b-b74f31a3c595 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:27.290200 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-d84efcc5-71e9-4b64-979b-b74f31a3c595 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:27.307264 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-d84efcc5-71e9-4b64-979b-b74f31a3c595 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:27.307987 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-d84efcc5-71e9-4b64-979b-b74f31a3c595 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:27.317080 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-d84efcc5-71e9-4b64-979b-b74f31a3c595 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:27.317822 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-d84efcc5-71e9-4b64-979b-b74f31a3c595 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:27.334070 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [req-e39aa428-25bb-4802-84a6-fbf8a3d28bba req-4dc9532d-25fa-489c-8ffc-e80745269084 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2217c82-c31b-4997-a07b-a3f3b15120f2", "name": "network-vif-unplugged", "status": "completed", "tag": "b39ad36c-c85b-4774-a7c4-2ec833039594"}]} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:33:27.334070 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:33:27.334070 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: warnings.warn(msg) Jan 18 16:33:27.343370 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-e39aa428-25bb-4802-84a6-fbf8a3d28bba req-4dc9532d-25fa-489c-8ffc-e80745269084 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:27.344015 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-e39aa428-25bb-4802-84a6-fbf8a3d28bba req-4dc9532d-25fa-489c-8ffc-e80745269084 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:27.375276 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.compute.server_external_events [req-e39aa428-25bb-4802-84a6-fbf8a3d28bba req-4dc9532d-25fa-489c-8ffc-e80745269084 service nova] Creating event network-vif-unplugged:b39ad36c-c85b-4774-a7c4-2ec833039594 for instance c2217c82-c31b-4997-a07b-a3f3b15120f2 on hv-cinder-78836 Jan 18 16:33:27.382784 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [req-e39aa428-25bb-4802-84a6-fbf8a3d28bba req-4dc9532d-25fa-489c-8ffc-e80745269084 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067594 Jan 18 16:33:27.383978 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 257/525] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 16:33:27.421242 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-001d6961-d0d3-4210-8831-7e0d762b606d tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:27.422185 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-001d6961-d0d3-4210-8831-7e0d762b606d tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c2217c82-c31b-4997-a07b-a3f3b15120f2] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:27.441694 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-001d6961-d0d3-4210-8831-7e0d762b606d tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:27.442659 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-001d6961-d0d3-4210-8831-7e0d762b606d tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:27.443714 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-001d6961-d0d3-4210-8831-7e0d762b606d tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:27.444337 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-001d6961-d0d3-4210-8831-7e0d762b606d tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:27.728754 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-d84efcc5-71e9-4b64-979b-b74f31a3c595 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:27.741803 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-d84efcc5-71e9-4b64-979b-b74f31a3c595 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1506 microversion: 2.1 time: 0.453938 Jan 18 16:33:27.742767 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 269/526] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:27 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1506 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:27.754488 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-3edc4549-2140-4342-92d9-15b3abec3ca5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:27.755099 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-3edc4549-2140-4342-92d9-15b3abec3ca5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:27.781225 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-3edc4549-2140-4342-92d9-15b3abec3ca5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:27.782513 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-3edc4549-2140-4342-92d9-15b3abec3ca5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:27.783479 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-3edc4549-2140-4342-92d9-15b3abec3ca5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:27.783897 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-3edc4549-2140-4342-92d9-15b3abec3ca5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:27.834362 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-001d6961-d0d3-4210-8831-7e0d762b606d tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9424067ecef94af9ae0828b77926f675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74e7f75a7c41be9e4e3f6884b4d832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:27.850347 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-001d6961-d0d3-4210-8831-7e0d762b606d tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2" status: 200 len: 1504 microversion: 2.1 time: 0.433505 Jan 18 16:33:27.851680 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 258/527] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:27 2022] GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2 => generated 1504 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:27.961687 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-22441602-296b-43c2-9ba8-0d02c02c51d2 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:27.962771 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-22441602-296b-43c2-9ba8-0d02c02c51d2 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:27.978926 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-22441602-296b-43c2-9ba8-0d02c02c51d2 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:27.979657 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-22441602-296b-43c2-9ba8-0d02c02c51d2 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:27.980613 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-22441602-296b-43c2-9ba8-0d02c02c51d2 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:27.981381 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-22441602-296b-43c2-9ba8-0d02c02c51d2 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:28.056250 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-3edc4549-2140-4342-92d9-15b3abec3ca5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:28.070114 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-3edc4549-2140-4342-92d9-15b3abec3ca5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:28.071914 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-3edc4549-2140-4342-92d9-15b3abec3ca5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:28.079686 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-3edc4549-2140-4342-92d9-15b3abec3ca5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1809 microversion: 2.20 time: 0.334612 Jan 18 16:33:28.082540 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 270/528] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:33:27 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1809 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:33:28.369064 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-22441602-296b-43c2-9ba8-0d02c02c51d2 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0509d42df8844400b99d7c060ab98c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:28.377964 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-22441602-296b-43c2-9ba8-0d02c02c51d2 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 200 len: 1358 microversion: 2.1 time: 0.420927 Jan 18 16:33:28.380043 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 259/529] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:27 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 1358 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:33:28.759632 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-ddb3624c-feda-4af8-b4ba-d10f2b9f62f6 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:28.760236 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-ddb3624c-feda-4af8-b4ba-d10f2b9f62f6 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:28.767778 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-ddb3624c-feda-4af8-b4ba-d10f2b9f62f6 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:28.768224 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-ddb3624c-feda-4af8-b4ba-d10f2b9f62f6 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:28.769039 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-ddb3624c-feda-4af8-b4ba-d10f2b9f62f6 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:28.769467 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-ddb3624c-feda-4af8-b4ba-d10f2b9f62f6 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:28.869634 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-8bec1a46-acdc-44aa-8c2c-7940def3d13c tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:28.870524 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-8bec1a46-acdc-44aa-8c2c-7940def3d13c tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c2217c82-c31b-4997-a07b-a3f3b15120f2] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:28.879743 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8bec1a46-acdc-44aa-8c2c-7940def3d13c tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:28.880192 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8bec1a46-acdc-44aa-8c2c-7940def3d13c tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:28.881206 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8bec1a46-acdc-44aa-8c2c-7940def3d13c tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:28.881826 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8bec1a46-acdc-44aa-8c2c-7940def3d13c tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:28.953352 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-ddb3624c-feda-4af8-b4ba-d10f2b9f62f6 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:28.966009 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-ddb3624c-feda-4af8-b4ba-d10f2b9f62f6 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1506 microversion: 2.1 time: 0.207569 Jan 18 16:33:28.973148 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 271/530] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:28 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1506 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:33:29.080575 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-8bec1a46-acdc-44aa-8c2c-7940def3d13c tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9424067ecef94af9ae0828b77926f675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74e7f75a7c41be9e4e3f6884b4d832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:29.088320 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-8bec1a46-acdc-44aa-8c2c-7940def3d13c tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2" status: 200 len: 1504 microversion: 2.1 time: 0.223238 Jan 18 16:33:29.088906 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 260/531] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:28 2022] GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2 => generated 1504 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:33:29.099349 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-0c290aef-a0f5-4132-8ac9-bb8dd5e60b54 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:29.100410 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-0c290aef-a0f5-4132-8ac9-bb8dd5e60b54 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:29.106790 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0c290aef-a0f5-4132-8ac9-bb8dd5e60b54 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:29.107354 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0c290aef-a0f5-4132-8ac9-bb8dd5e60b54 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:29.108170 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0c290aef-a0f5-4132-8ac9-bb8dd5e60b54 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:29.108598 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0c290aef-a0f5-4132-8ac9-bb8dd5e60b54 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:29.250956 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-0c290aef-a0f5-4132-8ac9-bb8dd5e60b54 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:29.258511 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-0c290aef-a0f5-4132-8ac9-bb8dd5e60b54 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:29.259919 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-0c290aef-a0f5-4132-8ac9-bb8dd5e60b54 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:29.261253 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-0c290aef-a0f5-4132-8ac9-bb8dd5e60b54 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1809 microversion: 2.20 time: 0.165648 Jan 18 16:33:29.261815 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 272/532] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:33:29 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:33:29.397815 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-75d27903-a836-4864-9a26-0d52382954aa tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:29.398416 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-75d27903-a836-4864-9a26-0d52382954aa tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:29.404399 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-75d27903-a836-4864-9a26-0d52382954aa tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:29.404844 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-75d27903-a836-4864-9a26-0d52382954aa tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:29.405716 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-75d27903-a836-4864-9a26-0d52382954aa tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:29.406140 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-75d27903-a836-4864-9a26-0d52382954aa tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:29.538756 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-75d27903-a836-4864-9a26-0d52382954aa tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0509d42df8844400b99d7c060ab98c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:29.546326 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-75d27903-a836-4864-9a26-0d52382954aa tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 200 len: 1358 microversion: 2.1 time: 0.152056 Jan 18 16:33:29.546900 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 261/533] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:29 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:29.983261 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-4f8757a1-5cf3-4f5e-9579-ce75832531c1 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:29.983858 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-4f8757a1-5cf3-4f5e-9579-ce75832531c1 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:29.990699 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4f8757a1-5cf3-4f5e-9579-ce75832531c1 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:29.991137 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4f8757a1-5cf3-4f5e-9579-ce75832531c1 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:29.991898 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4f8757a1-5cf3-4f5e-9579-ce75832531c1 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:29.992327 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4f8757a1-5cf3-4f5e-9579-ce75832531c1 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:30.108549 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-a69ee24b-9bb6-4af4-b568-d4ae57c37588 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:30.109216 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-a69ee24b-9bb6-4af4-b568-d4ae57c37588 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c2217c82-c31b-4997-a07b-a3f3b15120f2] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:30.116044 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a69ee24b-9bb6-4af4-b568-d4ae57c37588 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:30.116495 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a69ee24b-9bb6-4af4-b568-d4ae57c37588 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:30.117317 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a69ee24b-9bb6-4af4-b568-d4ae57c37588 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:30.117755 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a69ee24b-9bb6-4af4-b568-d4ae57c37588 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:30.134360 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-4f8757a1-5cf3-4f5e-9579-ce75832531c1 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:30.142285 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-4f8757a1-5cf3-4f5e-9579-ce75832531c1 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1506 microversion: 2.1 time: 0.162613 Jan 18 16:33:30.143373 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 273/534] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:29 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:30.254901 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-a69ee24b-9bb6-4af4-b568-d4ae57c37588 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9424067ecef94af9ae0828b77926f675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74e7f75a7c41be9e4e3f6884b4d832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:30.262066 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-a69ee24b-9bb6-4af4-b568-d4ae57c37588 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2" status: 200 len: 1504 microversion: 2.1 time: 0.160201 Jan 18 16:33:30.262633 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 262/535] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:30 2022] GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:30.279182 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-3b6682b1-f34d-4d12-a9b1-94d92e437fb1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:30.279780 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-3b6682b1-f34d-4d12-a9b1-94d92e437fb1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:30.285707 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-3b6682b1-f34d-4d12-a9b1-94d92e437fb1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:30.286145 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-3b6682b1-f34d-4d12-a9b1-94d92e437fb1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:30.286913 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-3b6682b1-f34d-4d12-a9b1-94d92e437fb1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:30.287337 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-3b6682b1-f34d-4d12-a9b1-94d92e437fb1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:30.419669 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-3b6682b1-f34d-4d12-a9b1-94d92e437fb1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:30.428551 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-3b6682b1-f34d-4d12-a9b1-94d92e437fb1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:30.430064 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-3b6682b1-f34d-4d12-a9b1-94d92e437fb1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:30.431192 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-3b6682b1-f34d-4d12-a9b1-94d92e437fb1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1809 microversion: 2.20 time: 0.155675 Jan 18 16:33:30.431737 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 274/536] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:33:30 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:33:30.563977 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-756f56a1-8c08-4572-b012-b9f88ccbcaa7 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:30.564616 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-756f56a1-8c08-4572-b012-b9f88ccbcaa7 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:30.570981 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-756f56a1-8c08-4572-b012-b9f88ccbcaa7 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:30.571446 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-756f56a1-8c08-4572-b012-b9f88ccbcaa7 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:30.572212 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-756f56a1-8c08-4572-b012-b9f88ccbcaa7 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:30.572648 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-756f56a1-8c08-4572-b012-b9f88ccbcaa7 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:30.706052 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-756f56a1-8c08-4572-b012-b9f88ccbcaa7 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0509d42df8844400b99d7c060ab98c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:30.713332 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-756f56a1-8c08-4572-b012-b9f88ccbcaa7 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 200 len: 1358 microversion: 2.1 time: 0.153116 Jan 18 16:33:30.713897 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 263/537] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:30 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:31.159210 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-45505d6c-268c-44da-adec-44e617d0f1a1 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:31.159816 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-45505d6c-268c-44da-adec-44e617d0f1a1 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:31.166176 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-45505d6c-268c-44da-adec-44e617d0f1a1 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:31.166627 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-45505d6c-268c-44da-adec-44e617d0f1a1 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:31.167404 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-45505d6c-268c-44da-adec-44e617d0f1a1 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:31.167838 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-45505d6c-268c-44da-adec-44e617d0f1a1 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:31.279036 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-3adba84e-7bbb-46bf-9e1e-469f03b28e9f tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:31.279689 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-3adba84e-7bbb-46bf-9e1e-469f03b28e9f tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c2217c82-c31b-4997-a07b-a3f3b15120f2] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:31.286680 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3adba84e-7bbb-46bf-9e1e-469f03b28e9f tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:31.287408 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3adba84e-7bbb-46bf-9e1e-469f03b28e9f tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:31.288203 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3adba84e-7bbb-46bf-9e1e-469f03b28e9f tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:31.288642 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3adba84e-7bbb-46bf-9e1e-469f03b28e9f tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:31.306773 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-45505d6c-268c-44da-adec-44e617d0f1a1 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:31.314001 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-45505d6c-268c-44da-adec-44e617d0f1a1 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1506 microversion: 2.1 time: 0.158676 Jan 18 16:33:31.314572 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 275/538] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:31 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:31.419936 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-3adba84e-7bbb-46bf-9e1e-469f03b28e9f tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9424067ecef94af9ae0828b77926f675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74e7f75a7c41be9e4e3f6884b4d832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:31.427886 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-3adba84e-7bbb-46bf-9e1e-469f03b28e9f tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2" status: 200 len: 1504 microversion: 2.1 time: 0.152549 Jan 18 16:33:31.428449 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 264/539] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:31 2022] GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:33:31.450187 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-78c9700a-0af6-44d4-ad5e-c14183637e90 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:31.450790 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-78c9700a-0af6-44d4-ad5e-c14183637e90 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:31.456524 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-78c9700a-0af6-44d4-ad5e-c14183637e90 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:31.456999 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-78c9700a-0af6-44d4-ad5e-c14183637e90 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:31.457779 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-78c9700a-0af6-44d4-ad5e-c14183637e90 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:31.458208 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-78c9700a-0af6-44d4-ad5e-c14183637e90 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:31.585285 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-78c9700a-0af6-44d4-ad5e-c14183637e90 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:31.593839 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-78c9700a-0af6-44d4-ad5e-c14183637e90 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:31.595948 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-78c9700a-0af6-44d4-ad5e-c14183637e90 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:31.597159 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-78c9700a-0af6-44d4-ad5e-c14183637e90 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1809 microversion: 2.20 time: 0.150691 Jan 18 16:33:31.597719 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 276/540] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:33:31 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:33:31.730550 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-658be973-8987-4a12-b81a-074f446bffbc tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:31.731160 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-658be973-8987-4a12-b81a-074f446bffbc tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:31.737728 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-658be973-8987-4a12-b81a-074f446bffbc tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:31.738265 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-658be973-8987-4a12-b81a-074f446bffbc tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:31.739054 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-658be973-8987-4a12-b81a-074f446bffbc tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:31.739510 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-658be973-8987-4a12-b81a-074f446bffbc tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:31.884042 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-658be973-8987-4a12-b81a-074f446bffbc tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0509d42df8844400b99d7c060ab98c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:31.893774 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-658be973-8987-4a12-b81a-074f446bffbc tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 200 len: 1358 microversion: 2.1 time: 0.166788 Jan 18 16:33:31.894375 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 265/541] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:31 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:32.330813 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-91efdb51-3582-4456-84de-8483d832d36b tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:32.331592 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-91efdb51-3582-4456-84de-8483d832d36b tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:32.338014 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-91efdb51-3582-4456-84de-8483d832d36b tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:32.338457 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-91efdb51-3582-4456-84de-8483d832d36b tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:32.339230 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-91efdb51-3582-4456-84de-8483d832d36b tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:32.339657 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-91efdb51-3582-4456-84de-8483d832d36b tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:32.444677 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-6999ebe9-26d7-4b1e-9d9c-b8f3e42e9489 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:32.446070 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-6999ebe9-26d7-4b1e-9d9c-b8f3e42e9489 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c2217c82-c31b-4997-a07b-a3f3b15120f2] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:32.452572 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-6999ebe9-26d7-4b1e-9d9c-b8f3e42e9489 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:32.453819 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-6999ebe9-26d7-4b1e-9d9c-b8f3e42e9489 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:32.454719 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-6999ebe9-26d7-4b1e-9d9c-b8f3e42e9489 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:32.455265 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-6999ebe9-26d7-4b1e-9d9c-b8f3e42e9489 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:32.487566 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-91efdb51-3582-4456-84de-8483d832d36b tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:32.498636 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-91efdb51-3582-4456-84de-8483d832d36b tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1506 microversion: 2.1 time: 0.171482 Jan 18 16:33:32.500116 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 277/542] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:32 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1506 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:32.617376 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-765a3fa1-64be-4e19-9b8c-24f7696680e7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:32.618394 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-765a3fa1-64be-4e19-9b8c-24f7696680e7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:32.630393 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-765a3fa1-64be-4e19-9b8c-24f7696680e7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:32.631215 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-765a3fa1-64be-4e19-9b8c-24f7696680e7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:32.632222 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-765a3fa1-64be-4e19-9b8c-24f7696680e7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:32.632841 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-765a3fa1-64be-4e19-9b8c-24f7696680e7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:32.638545 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-6999ebe9-26d7-4b1e-9d9c-b8f3e42e9489 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9424067ecef94af9ae0828b77926f675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74e7f75a7c41be9e4e3f6884b4d832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:32.648819 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-6999ebe9-26d7-4b1e-9d9c-b8f3e42e9489 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2" status: 200 len: 1504 microversion: 2.1 time: 0.207932 Jan 18 16:33:32.649885 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 266/543] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:32 2022] GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2 => generated 1504 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:33:32.796307 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-765a3fa1-64be-4e19-9b8c-24f7696680e7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:32.805221 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-765a3fa1-64be-4e19-9b8c-24f7696680e7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:32.806702 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-765a3fa1-64be-4e19-9b8c-24f7696680e7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:32.807860 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-765a3fa1-64be-4e19-9b8c-24f7696680e7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1809 microversion: 2.20 time: 0.195733 Jan 18 16:33:32.808399 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 278/544] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:33:32 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1809 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 16:33:32.911110 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-bb681070-5d27-40b4-bcd6-5f4a9fc40915 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:32.911814 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-bb681070-5d27-40b4-bcd6-5f4a9fc40915 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:32.917691 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-bb681070-5d27-40b4-bcd6-5f4a9fc40915 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:32.918202 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-bb681070-5d27-40b4-bcd6-5f4a9fc40915 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:32.919069 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-bb681070-5d27-40b4-bcd6-5f4a9fc40915 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:32.919566 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-bb681070-5d27-40b4-bcd6-5f4a9fc40915 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:33.022652 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [req-cf85d6e0-b3dd-4fdb-8833-444c0fdb4bc3 req-b5abd97c-4f94-4185-87c0-b1a054eb3e82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2217c82-c31b-4997-a07b-a3f3b15120f2", "name": "network-vif-deleted", "tag": "b39ad36c-c85b-4774-a7c4-2ec833039594"}]} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:33:33.026282 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:33:33.026282 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: warnings.warn(msg) Jan 18 16:33:33.043892 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-cf85d6e0-b3dd-4fdb-8833-444c0fdb4bc3 req-b5abd97c-4f94-4185-87c0-b1a054eb3e82 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:33.044774 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-cf85d6e0-b3dd-4fdb-8833-444c0fdb4bc3 req-b5abd97c-4f94-4185-87c0-b1a054eb3e82 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:33.060650 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.compute.server_external_events [req-cf85d6e0-b3dd-4fdb-8833-444c0fdb4bc3 req-b5abd97c-4f94-4185-87c0-b1a054eb3e82 service nova] Creating event network-vif-deleted:b39ad36c-c85b-4774-a7c4-2ec833039594 for instance c2217c82-c31b-4997-a07b-a3f3b15120f2 on hv-cinder-78836 Jan 18 16:33:33.067465 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [req-cf85d6e0-b3dd-4fdb-8833-444c0fdb4bc3 req-b5abd97c-4f94-4185-87c0-b1a054eb3e82 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049106 Jan 18 16:33:33.071669 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 279/545] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 16:33:33.081628 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-bb681070-5d27-40b4-bcd6-5f4a9fc40915 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0509d42df8844400b99d7c060ab98c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:33.089583 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-bb681070-5d27-40b4-bcd6-5f4a9fc40915 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 200 len: 1358 microversion: 2.1 time: 0.182727 Jan 18 16:33:33.090469 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 267/546] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:32 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:33.520111 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-62dc9a95-4470-4eab-9070-fe0edb473da5 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:33.520727 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-62dc9a95-4470-4eab-9070-fe0edb473da5 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:33.526840 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-62dc9a95-4470-4eab-9070-fe0edb473da5 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:33.527291 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-62dc9a95-4470-4eab-9070-fe0edb473da5 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:33.528073 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-62dc9a95-4470-4eab-9070-fe0edb473da5 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:33.528508 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-62dc9a95-4470-4eab-9070-fe0edb473da5 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:33.593159 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-62dc9a95-4470-4eab-9070-fe0edb473da5 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:33.600697 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-62dc9a95-4470-4eab-9070-fe0edb473da5 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1464 microversion: 2.1 time: 0.086201 Jan 18 16:33:33.601290 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 280/547] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:33 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1464 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:33.667950 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-ff03e69b-46f1-4c04-af17-ef55020ffa56 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:33.668679 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-ff03e69b-46f1-4c04-af17-ef55020ffa56 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c2217c82-c31b-4997-a07b-a3f3b15120f2] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:33.675389 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ff03e69b-46f1-4c04-af17-ef55020ffa56 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:33.675832 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ff03e69b-46f1-4c04-af17-ef55020ffa56 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:33.676605 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ff03e69b-46f1-4c04-af17-ef55020ffa56 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:33.677069 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ff03e69b-46f1-4c04-af17-ef55020ffa56 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:33.740621 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-ff03e69b-46f1-4c04-af17-ef55020ffa56 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9424067ecef94af9ae0828b77926f675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74e7f75a7c41be9e4e3f6884b4d832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:33.748066 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-ff03e69b-46f1-4c04-af17-ef55020ffa56 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2" status: 200 len: 1462 microversion: 2.1 time: 0.084032 Jan 18 16:33:33.748627 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 268/548] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:33 2022] GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2 => generated 1462 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:33.826687 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-70677692-c9b8-49dd-95c9-a9d1872c281b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:33.827200 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-70677692-c9b8-49dd-95c9-a9d1872c281b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:33.833656 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-70677692-c9b8-49dd-95c9-a9d1872c281b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:33.834099 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-70677692-c9b8-49dd-95c9-a9d1872c281b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:33.834852 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-70677692-c9b8-49dd-95c9-a9d1872c281b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:33.835282 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-70677692-c9b8-49dd-95c9-a9d1872c281b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:33.965856 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-70677692-c9b8-49dd-95c9-a9d1872c281b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:33.976355 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-70677692-c9b8-49dd-95c9-a9d1872c281b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:33.977996 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-70677692-c9b8-49dd-95c9-a9d1872c281b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:33.979361 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-70677692-c9b8-49dd-95c9-a9d1872c281b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1809 microversion: 2.20 time: 0.156518 Jan 18 16:33:33.980050 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 281/549] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:33:33 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:33:34.107149 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-82ea3704-b306-4250-8909-4ffd7234a23c tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:34.107761 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-82ea3704-b306-4250-8909-4ffd7234a23c tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:34.115883 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-82ea3704-b306-4250-8909-4ffd7234a23c tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:34.116453 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-82ea3704-b306-4250-8909-4ffd7234a23c tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:34.117295 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-82ea3704-b306-4250-8909-4ffd7234a23c tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:34.117737 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-82ea3704-b306-4250-8909-4ffd7234a23c tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:34.251864 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-82ea3704-b306-4250-8909-4ffd7234a23c tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0509d42df8844400b99d7c060ab98c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:34.259176 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-82ea3704-b306-4250-8909-4ffd7234a23c tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 200 len: 1358 microversion: 2.1 time: 0.155602 Jan 18 16:33:34.259879 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 269/550] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:34 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:34.618731 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-53c7aeaa-e6fd-4cd7-aecf-c9728996f660 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:34.619334 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-53c7aeaa-e6fd-4cd7-aecf-c9728996f660 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:34.625174 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-53c7aeaa-e6fd-4cd7-aecf-c9728996f660 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:34.626165 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-53c7aeaa-e6fd-4cd7-aecf-c9728996f660 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:34.626940 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-53c7aeaa-e6fd-4cd7-aecf-c9728996f660 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:34.627374 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-53c7aeaa-e6fd-4cd7-aecf-c9728996f660 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:34.689612 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-53c7aeaa-e6fd-4cd7-aecf-c9728996f660 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:34.697100 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-53c7aeaa-e6fd-4cd7-aecf-c9728996f660 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1464 microversion: 2.1 time: 0.082199 Jan 18 16:33:34.697662 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 282/551] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:34 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1464 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:34.765215 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-f637ef43-267a-45ab-8b38-9f1a1504293d tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:34.766353 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-f637ef43-267a-45ab-8b38-9f1a1504293d tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c2217c82-c31b-4997-a07b-a3f3b15120f2] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:34.772839 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f637ef43-267a-45ab-8b38-9f1a1504293d tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:34.773315 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f637ef43-267a-45ab-8b38-9f1a1504293d tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:34.774102 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f637ef43-267a-45ab-8b38-9f1a1504293d tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:34.774533 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f637ef43-267a-45ab-8b38-9f1a1504293d tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:34.840886 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-f637ef43-267a-45ab-8b38-9f1a1504293d tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9424067ecef94af9ae0828b77926f675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74e7f75a7c41be9e4e3f6884b4d832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:34.848992 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-f637ef43-267a-45ab-8b38-9f1a1504293d tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2" status: 200 len: 1462 microversion: 2.1 time: 0.087703 Jan 18 16:33:34.849551 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 270/552] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:34 2022] GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2 => generated 1462 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:34.998014 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-b57a3b4f-3ad3-4e67-8754-cd366cad7708 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:34.998619 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-b57a3b4f-3ad3-4e67-8754-cd366cad7708 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:35.004555 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-b57a3b4f-3ad3-4e67-8754-cd366cad7708 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:35.005033 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-b57a3b4f-3ad3-4e67-8754-cd366cad7708 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:35.005809 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-b57a3b4f-3ad3-4e67-8754-cd366cad7708 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:35.006243 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-b57a3b4f-3ad3-4e67-8754-cd366cad7708 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:35.090576 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [req-4e43ed4a-c247-4b85-984d-d843a45e6a16 req-db215bde-e64f-4911-ae33-7a737bbd797a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81185063-e397-4416-9d88-33fd33859fe1", "name": "network-vif-deleted", "tag": "11d4eb96-5b48-447f-b96d-d55d1869150b"}]} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:33:35.092211 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:33:35.092211 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: warnings.warn(msg) Jan 18 16:33:35.099882 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-4e43ed4a-c247-4b85-984d-d843a45e6a16 req-db215bde-e64f-4911-ae33-7a737bbd797a service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:35.100418 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-4e43ed4a-c247-4b85-984d-d843a45e6a16 req-db215bde-e64f-4911-ae33-7a737bbd797a service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:35.112382 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.compute.server_external_events [req-4e43ed4a-c247-4b85-984d-d843a45e6a16 req-db215bde-e64f-4911-ae33-7a737bbd797a service nova] Creating event network-vif-deleted:11d4eb96-5b48-447f-b96d-d55d1869150b for instance 81185063-e397-4416-9d88-33fd33859fe1 on hv-cinder-78836 Jan 18 16:33:35.117304 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [req-4e43ed4a-c247-4b85-984d-d843a45e6a16 req-db215bde-e64f-4911-ae33-7a737bbd797a service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030370 Jan 18 16:33:35.117912 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 271/553] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 16:33:35.145797 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-b57a3b4f-3ad3-4e67-8754-cd366cad7708 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:35.160115 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-b57a3b4f-3ad3-4e67-8754-cd366cad7708 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:35.162933 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-b57a3b4f-3ad3-4e67-8754-cd366cad7708 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:35.166454 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-b57a3b4f-3ad3-4e67-8754-cd366cad7708 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1809 microversion: 2.20 time: 0.172110 Jan 18 16:33:35.167498 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 283/554] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:33:34 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:33:35.275442 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-83d0baaa-6cd5-4584-9106-3f027f2585ca tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:35.276131 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-83d0baaa-6cd5-4584-9106-3f027f2585ca tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:35.283915 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-83d0baaa-6cd5-4584-9106-3f027f2585ca tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:35.284347 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-83d0baaa-6cd5-4584-9106-3f027f2585ca tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:35.285166 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-83d0baaa-6cd5-4584-9106-3f027f2585ca tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:35.285600 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-83d0baaa-6cd5-4584-9106-3f027f2585ca tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:35.430820 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-83d0baaa-6cd5-4584-9106-3f027f2585ca tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0509d42df8844400b99d7c060ab98c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:35.439807 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-83d0baaa-6cd5-4584-9106-3f027f2585ca tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 200 len: 1358 microversion: 2.1 time: 0.168224 Jan 18 16:33:35.440400 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 272/555] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:35 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:35.715148 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-8853c9b3-884b-4188-b516-56409a98505f tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:35.715750 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-8853c9b3-884b-4188-b516-56409a98505f tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:35.723074 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-8853c9b3-884b-4188-b516-56409a98505f tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:35.723523 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-8853c9b3-884b-4188-b516-56409a98505f tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:35.724310 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-8853c9b3-884b-4188-b516-56409a98505f tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:35.724743 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-8853c9b3-884b-4188-b516-56409a98505f tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:35.785754 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-8853c9b3-884b-4188-b516-56409a98505f tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:35.793015 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-8853c9b3-884b-4188-b516-56409a98505f tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1464 microversion: 2.1 time: 0.081496 Jan 18 16:33:35.793574 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 284/556] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:35 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1464 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:35.865745 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-74d54b34-a581-4148-a8ab-366317adc7f1 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:35.866383 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-74d54b34-a581-4148-a8ab-366317adc7f1 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c2217c82-c31b-4997-a07b-a3f3b15120f2] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:35.872744 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-74d54b34-a581-4148-a8ab-366317adc7f1 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:35.873222 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-74d54b34-a581-4148-a8ab-366317adc7f1 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:35.873996 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-74d54b34-a581-4148-a8ab-366317adc7f1 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:35.874460 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-74d54b34-a581-4148-a8ab-366317adc7f1 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:35.932817 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-74d54b34-a581-4148-a8ab-366317adc7f1 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9424067ecef94af9ae0828b77926f675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74e7f75a7c41be9e4e3f6884b4d832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:35.940909 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-74d54b34-a581-4148-a8ab-366317adc7f1 tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2" status: 200 len: 1299 microversion: 2.1 time: 0.078549 Jan 18 16:33:35.941503 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 273/557] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:35 2022] GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2 => generated 1299 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:36.191725 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-67863d2a-554c-4007-bbdc-f61a0f3cd3c9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:36.192327 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-67863d2a-554c-4007-bbdc-f61a0f3cd3c9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:36.198279 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-67863d2a-554c-4007-bbdc-f61a0f3cd3c9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:36.198726 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-67863d2a-554c-4007-bbdc-f61a0f3cd3c9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:36.199496 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-67863d2a-554c-4007-bbdc-f61a0f3cd3c9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:36.199927 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-67863d2a-554c-4007-bbdc-f61a0f3cd3c9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:36.367847 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-67863d2a-554c-4007-bbdc-f61a0f3cd3c9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:36.377330 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-67863d2a-554c-4007-bbdc-f61a0f3cd3c9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:36.379131 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-67863d2a-554c-4007-bbdc-f61a0f3cd3c9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:36.380422 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-67863d2a-554c-4007-bbdc-f61a0f3cd3c9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1809 microversion: 2.20 time: 0.193788 Jan 18 16:33:36.385573 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 285/558] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:33:36 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1809 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:33:36.458748 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-898fd8c3-dd8f-4df4-a2cd-3d295aa083d7 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:36.459348 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-898fd8c3-dd8f-4df4-a2cd-3d295aa083d7 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:36.466060 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-898fd8c3-dd8f-4df4-a2cd-3d295aa083d7 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:36.466558 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-898fd8c3-dd8f-4df4-a2cd-3d295aa083d7 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:36.467336 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-898fd8c3-dd8f-4df4-a2cd-3d295aa083d7 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:36.467762 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-898fd8c3-dd8f-4df4-a2cd-3d295aa083d7 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:36.602230 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-898fd8c3-dd8f-4df4-a2cd-3d295aa083d7 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0509d42df8844400b99d7c060ab98c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:36.609583 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-898fd8c3-dd8f-4df4-a2cd-3d295aa083d7 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 200 len: 1358 microversion: 2.1 time: 0.155055 Jan 18 16:33:36.610150 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 274/559] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:36 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:36.809069 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-27a6f7de-08ec-4c6b-a458-a03240fa1d8f tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:36.809675 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-27a6f7de-08ec-4c6b-a458-a03240fa1d8f tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:36.816887 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-27a6f7de-08ec-4c6b-a458-a03240fa1d8f tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:36.817382 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-27a6f7de-08ec-4c6b-a458-a03240fa1d8f tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:36.818167 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-27a6f7de-08ec-4c6b-a458-a03240fa1d8f tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:36.818603 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-27a6f7de-08ec-4c6b-a458-a03240fa1d8f tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:36.851892 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-27a6f7de-08ec-4c6b-a458-a03240fa1d8f tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:36.852258 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-27a6f7de-08ec-4c6b-a458-a03240fa1d8f tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:36.852576 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.objects.instance [None req-27a6f7de-08ec-4c6b-a458-a03240fa1d8f tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lazy-loading 'fault' on Instance uuid 81185063-e397-4416-9d88-33fd33859fe1 {{(pid=116367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 18 16:33:36.897266 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-27a6f7de-08ec-4c6b-a458-a03240fa1d8f tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:36.904833 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-27a6f7de-08ec-4c6b-a458-a03240fa1d8f tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 200 len: 1311 microversion: 2.1 time: 0.099862 Jan 18 16:33:36.905450 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 286/560] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:36 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 1311 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:36.957746 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-7aeff512-d974-4146-8538-a3f1e460035d tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:36.958761 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-7aeff512-d974-4146-8538-a3f1e460035d tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c2217c82-c31b-4997-a07b-a3f3b15120f2] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:36.966258 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7aeff512-d974-4146-8538-a3f1e460035d tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:36.968757 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7aeff512-d974-4146-8538-a3f1e460035d tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:36.969610 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7aeff512-d974-4146-8538-a3f1e460035d tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:36.970258 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7aeff512-d974-4146-8538-a3f1e460035d tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:37.008342 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7aeff512-d974-4146-8538-a3f1e460035d tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:37.008814 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7aeff512-d974-4146-8538-a3f1e460035d tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:37.009424 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.objects.instance [None req-7aeff512-d974-4146-8538-a3f1e460035d tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lazy-loading 'fault' on Instance uuid c2217c82-c31b-4997-a07b-a3f3b15120f2 {{(pid=116368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 18 16:33:37.053584 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-7aeff512-d974-4146-8538-a3f1e460035d tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9424067ecef94af9ae0828b77926f675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74e7f75a7c41be9e4e3f6884b4d832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:37.061407 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-7aeff512-d974-4146-8538-a3f1e460035d tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2" status: 200 len: 1304 microversion: 2.1 time: 0.107889 Jan 18 16:33:37.062328 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 275/561] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:36 2022] GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2 => generated 1304 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:37.399120 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-a3d2fa8b-81ad-4b24-bd0a-94b295f81195 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:37.399720 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-a3d2fa8b-81ad-4b24-bd0a-94b295f81195 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:37.406703 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a3d2fa8b-81ad-4b24-bd0a-94b295f81195 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:37.406703 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a3d2fa8b-81ad-4b24-bd0a-94b295f81195 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:37.406703 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a3d2fa8b-81ad-4b24-bd0a-94b295f81195 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:37.407053 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a3d2fa8b-81ad-4b24-bd0a-94b295f81195 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:37.541123 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-a3d2fa8b-81ad-4b24-bd0a-94b295f81195 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:37.550103 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-a3d2fa8b-81ad-4b24-bd0a-94b295f81195 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:37.551583 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-a3d2fa8b-81ad-4b24-bd0a-94b295f81195 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:37.552727 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-a3d2fa8b-81ad-4b24-bd0a-94b295f81195 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1809 microversion: 2.20 time: 0.157291 Jan 18 16:33:37.553324 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 287/562] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:33:37 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:33:37.626077 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-babf8431-4889-4139-ab7e-e08890119339 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:37.626880 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-babf8431-4889-4139-ab7e-e08890119339 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:37.632807 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-babf8431-4889-4139-ab7e-e08890119339 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:37.633342 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-babf8431-4889-4139-ab7e-e08890119339 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:37.634143 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-babf8431-4889-4139-ab7e-e08890119339 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:37.634579 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-babf8431-4889-4139-ab7e-e08890119339 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:37.769626 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-babf8431-4889-4139-ab7e-e08890119339 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0509d42df8844400b99d7c060ab98c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:37.777157 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-babf8431-4889-4139-ab7e-e08890119339 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 200 len: 1358 microversion: 2.1 time: 0.154709 Jan 18 16:33:37.777741 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 276/563] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:37 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:37.921484 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-411f86f1-e7d5-4e98-87d1-66d6433683fd tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:37.922095 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-411f86f1-e7d5-4e98-87d1-66d6433683fd tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: 81185063-e397-4416-9d88-33fd33859fe1] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:37.928415 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-411f86f1-e7d5-4e98-87d1-66d6433683fd tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:37.928866 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-411f86f1-e7d5-4e98-87d1-66d6433683fd tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:37.929680 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-411f86f1-e7d5-4e98-87d1-66d6433683fd tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:37.930116 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-411f86f1-e7d5-4e98-87d1-66d6433683fd tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:37.943546 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.wsgi [None req-411f86f1-e7d5-4e98-87d1-66d6433683fd tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] HTTP exception thrown: Instance 81185063-e397-4416-9d88-33fd33859fe1 could not be found. Jan 18 16:33:37.944138 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-411f86f1-e7d5-4e98-87d1-66d6433683fd tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Returning 404 to user: Instance 81185063-e397-4416-9d88-33fd33859fe1 could not be found. {{(pid=116367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 16:33:37.945000 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-411f86f1-e7d5-4e98-87d1-66d6433683fd tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1" status: 404 len: 111 microversion: 2.1 time: 0.027086 Jan 18 16:33:37.945557 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 288/564] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:37 2022] GET /compute/v2.1/servers/81185063-e397-4416-9d88-33fd33859fe1 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 16:33:37.953354 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-bf55d58c-b31a-45f5-8e8e-780b328eef21 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:37.953853 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-bf55d58c-b31a-45f5-8e8e-780b328eef21 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:37.960179 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-bf55d58c-b31a-45f5-8e8e-780b328eef21 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:37.960790 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-bf55d58c-b31a-45f5-8e8e-780b328eef21 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:37.961448 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-bf55d58c-b31a-45f5-8e8e-780b328eef21 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:37.961883 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-bf55d58c-b31a-45f5-8e8e-780b328eef21 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:37.988523 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-bf55d58c-b31a-45f5-8e8e-780b328eef21 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Going to try to terminate instance {{(pid=116368) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 18 16:33:38.067950 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-bf55d58c-b31a-45f5-8e8e-780b328eef21 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "DELETE /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 204 len: 0 microversion: 2.1 time: 0.116856 Jan 18 16:33:38.070619 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 277/565] 10.222.0.82 () {58 vars in 1238 bytes} [Tue Jan 18 16:33:37 2022] DELETE /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 18 16:33:38.075547 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-7eba9ad3-1e3c-4889-ac06-0217a71f0a42 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:38.076105 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-7eba9ad3-1e3c-4889-ac06-0217a71f0a42 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:38.081571 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-1e40d362-0083-4e4a-9442-332f1c8c231a tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:38.082354 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-1e40d362-0083-4e4a-9442-332f1c8c231a tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] [instance: c2217c82-c31b-4997-a07b-a3f3b15120f2] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:38.082769 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7eba9ad3-1e3c-4889-ac06-0217a71f0a42 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:38.083218 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7eba9ad3-1e3c-4889-ac06-0217a71f0a42 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:38.084007 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7eba9ad3-1e3c-4889-ac06-0217a71f0a42 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:38.084447 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7eba9ad3-1e3c-4889-ac06-0217a71f0a42 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:38.088517 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1e40d362-0083-4e4a-9442-332f1c8c231a tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:38.089000 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1e40d362-0083-4e4a-9442-332f1c8c231a tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:38.089792 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1e40d362-0083-4e4a-9442-332f1c8c231a tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:38.090233 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1e40d362-0083-4e4a-9442-332f1c8c231a tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:38.104819 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.wsgi [None req-1e40d362-0083-4e4a-9442-332f1c8c231a tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] HTTP exception thrown: Instance c2217c82-c31b-4997-a07b-a3f3b15120f2 could not be found. Jan 18 16:33:38.105460 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-1e40d362-0083-4e4a-9442-332f1c8c231a tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] Returning 404 to user: Instance c2217c82-c31b-4997-a07b-a3f3b15120f2 could not be found. {{(pid=116368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 16:33:38.106319 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-1e40d362-0083-4e4a-9442-332f1c8c231a tempest-VolumesActionsTest-518993571 tempest-VolumesActionsTest-518993571-project] 10.222.0.82 "GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2" status: 404 len: 111 microversion: 2.1 time: 0.029627 Jan 18 16:33:38.106913 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 278/566] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:38 2022] GET /compute/v2.1/servers/c2217c82-c31b-4997-a07b-a3f3b15120f2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 18 16:33:38.239102 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-7eba9ad3-1e3c-4889-ac06-0217a71f0a42 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:38.246302 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-7eba9ad3-1e3c-4889-ac06-0217a71f0a42 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1520 microversion: 2.1 time: 0.174500 Jan 18 16:33:38.256810 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 289/567] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:38 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:33:38.571370 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-a4586af3-83e6-47cf-b0fd-c7836748d6eb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:38.572059 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-a4586af3-83e6-47cf-b0fd-c7836748d6eb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:38.578480 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a4586af3-83e6-47cf-b0fd-c7836748d6eb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:38.578940 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a4586af3-83e6-47cf-b0fd-c7836748d6eb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:38.579805 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a4586af3-83e6-47cf-b0fd-c7836748d6eb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:38.580236 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a4586af3-83e6-47cf-b0fd-c7836748d6eb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:38.794645 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-774874ea-0885-4a42-884c-636b381a147d tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:38.795261 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-774874ea-0885-4a42-884c-636b381a147d tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:38.802254 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-774874ea-0885-4a42-884c-636b381a147d tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:38.802713 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-774874ea-0885-4a42-884c-636b381a147d tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:38.803511 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-774874ea-0885-4a42-884c-636b381a147d tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:38.803948 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-774874ea-0885-4a42-884c-636b381a147d tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:38.972506 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-a4586af3-83e6-47cf-b0fd-c7836748d6eb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:38.981341 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-a4586af3-83e6-47cf-b0fd-c7836748d6eb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:38.982834 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-a4586af3-83e6-47cf-b0fd-c7836748d6eb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:38.983984 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-a4586af3-83e6-47cf-b0fd-c7836748d6eb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1809 microversion: 2.20 time: 0.417087 Jan 18 16:33:38.984541 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 279/568] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:33:38 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1809 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:33:39.040199 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-774874ea-0885-4a42-884c-636b381a147d tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0509d42df8844400b99d7c060ab98c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:39.047722 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-774874ea-0885-4a42-884c-636b381a147d tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 200 len: 1358 microversion: 2.1 time: 0.256649 Jan 18 16:33:39.049092 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 290/569] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:38 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 1358 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:33:39.263432 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-6fe0fcd0-8fa8-4960-be49-6e91d6176b83 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:39.264046 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-6fe0fcd0-8fa8-4960-be49-6e91d6176b83 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:39.271131 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-6fe0fcd0-8fa8-4960-be49-6e91d6176b83 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:39.271583 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-6fe0fcd0-8fa8-4960-be49-6e91d6176b83 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:39.272362 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-6fe0fcd0-8fa8-4960-be49-6e91d6176b83 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:39.272800 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-6fe0fcd0-8fa8-4960-be49-6e91d6176b83 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:39.403620 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-6fe0fcd0-8fa8-4960-be49-6e91d6176b83 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:39.411487 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-6fe0fcd0-8fa8-4960-be49-6e91d6176b83 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1520 microversion: 2.1 time: 0.151711 Jan 18 16:33:39.412048 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 280/570] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:39 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:40.003068 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-6c6aeb09-e9c6-43d8-a58a-576de3489196 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:40.003656 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-6c6aeb09-e9c6-43d8-a58a-576de3489196 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:40.009796 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6c6aeb09-e9c6-43d8-a58a-576de3489196 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:40.010237 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6c6aeb09-e9c6-43d8-a58a-576de3489196 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:40.011001 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6c6aeb09-e9c6-43d8-a58a-576de3489196 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:40.011461 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6c6aeb09-e9c6-43d8-a58a-576de3489196 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:40.065595 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-9674db7d-f82b-40f5-bef7-4c1e140f3fda tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:40.067040 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-9674db7d-f82b-40f5-bef7-4c1e140f3fda tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:40.073776 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-9674db7d-f82b-40f5-bef7-4c1e140f3fda tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:40.074197 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-9674db7d-f82b-40f5-bef7-4c1e140f3fda tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:40.074978 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-9674db7d-f82b-40f5-bef7-4c1e140f3fda tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:40.075406 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-9674db7d-f82b-40f5-bef7-4c1e140f3fda tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:40.177941 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-6c6aeb09-e9c6-43d8-a58a-576de3489196 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:40.186172 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-6c6aeb09-e9c6-43d8-a58a-576de3489196 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:40.187673 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-6c6aeb09-e9c6-43d8-a58a-576de3489196 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:40.188817 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-6c6aeb09-e9c6-43d8-a58a-576de3489196 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1809 microversion: 2.20 time: 0.190146 Jan 18 16:33:40.190205 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 291/571] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:33:39 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1809 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:33:40.239481 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-9674db7d-f82b-40f5-bef7-4c1e140f3fda tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0509d42df8844400b99d7c060ab98c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:40.248318 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-9674db7d-f82b-40f5-bef7-4c1e140f3fda tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 200 len: 1358 microversion: 2.1 time: 0.186998 Jan 18 16:33:40.249505 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 281/572] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:40 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:33:40.432615 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-cfce1ce0-8bdd-4174-a944-037d8099452e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:40.433250 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-cfce1ce0-8bdd-4174-a944-037d8099452e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:40.439799 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-cfce1ce0-8bdd-4174-a944-037d8099452e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:40.440118 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-cfce1ce0-8bdd-4174-a944-037d8099452e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:40.441179 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-cfce1ce0-8bdd-4174-a944-037d8099452e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:40.441613 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-cfce1ce0-8bdd-4174-a944-037d8099452e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:40.591036 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-cfce1ce0-8bdd-4174-a944-037d8099452e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:40.598417 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-cfce1ce0-8bdd-4174-a944-037d8099452e tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1520 microversion: 2.1 time: 0.173756 Jan 18 16:33:40.598970 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 292/573] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:40 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:41.208004 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-b369c0e7-fd7b-4123-aa79-c77106ccb888 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:41.208712 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-b369c0e7-fd7b-4123-aa79-c77106ccb888 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:41.215660 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-b369c0e7-fd7b-4123-aa79-c77106ccb888 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:41.216154 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-b369c0e7-fd7b-4123-aa79-c77106ccb888 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:41.216973 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-b369c0e7-fd7b-4123-aa79-c77106ccb888 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:41.217414 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-b369c0e7-fd7b-4123-aa79-c77106ccb888 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:41.265786 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-c6cee54d-2fcc-40d6-8fef-51b6e70ee69a tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:41.266392 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-c6cee54d-2fcc-40d6-8fef-51b6e70ee69a tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:41.273246 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c6cee54d-2fcc-40d6-8fef-51b6e70ee69a tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:41.273711 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c6cee54d-2fcc-40d6-8fef-51b6e70ee69a tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:41.276848 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c6cee54d-2fcc-40d6-8fef-51b6e70ee69a tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:41.276848 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c6cee54d-2fcc-40d6-8fef-51b6e70ee69a tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:41.384422 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-b369c0e7-fd7b-4123-aa79-c77106ccb888 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:41.393870 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-b369c0e7-fd7b-4123-aa79-c77106ccb888 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:41.395362 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-b369c0e7-fd7b-4123-aa79-c77106ccb888 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:41.396763 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-b369c0e7-fd7b-4123-aa79-c77106ccb888 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1809 microversion: 2.20 time: 0.192817 Jan 18 16:33:41.397357 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 282/574] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:33:41 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1809 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 16:33:41.442184 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-c6cee54d-2fcc-40d6-8fef-51b6e70ee69a tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0509d42df8844400b99d7c060ab98c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:41.449658 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-c6cee54d-2fcc-40d6-8fef-51b6e70ee69a tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 200 len: 1358 microversion: 2.1 time: 0.187542 Jan 18 16:33:41.450297 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 293/575] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:41 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:33:41.615274 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-53cab017-81a6-4578-baad-6b140c2efbd2 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:41.615886 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-53cab017-81a6-4578-baad-6b140c2efbd2 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:41.621763 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-53cab017-81a6-4578-baad-6b140c2efbd2 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:41.622204 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-53cab017-81a6-4578-baad-6b140c2efbd2 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:41.622982 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-53cab017-81a6-4578-baad-6b140c2efbd2 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:41.623416 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-53cab017-81a6-4578-baad-6b140c2efbd2 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:41.753662 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-53cab017-81a6-4578-baad-6b140c2efbd2 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:41.761152 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-53cab017-81a6-4578-baad-6b140c2efbd2 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1520 microversion: 2.1 time: 0.149617 Jan 18 16:33:41.761725 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 283/576] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:41 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:42.414569 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-5bfe673b-29b8-4c22-a7f6-23155b742ef9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:42.415602 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-5bfe673b-29b8-4c22-a7f6-23155b742ef9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:42.423629 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-5bfe673b-29b8-4c22-a7f6-23155b742ef9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:42.424523 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-5bfe673b-29b8-4c22-a7f6-23155b742ef9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:42.425886 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-5bfe673b-29b8-4c22-a7f6-23155b742ef9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:42.426318 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-5bfe673b-29b8-4c22-a7f6-23155b742ef9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:42.467662 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-5a82ce0c-0f2d-4d60-8fab-1aea51febd20 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:42.468508 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-5a82ce0c-0f2d-4d60-8fab-1aea51febd20 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:42.476008 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-5a82ce0c-0f2d-4d60-8fab-1aea51febd20 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:42.476460 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-5a82ce0c-0f2d-4d60-8fab-1aea51febd20 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:42.477312 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-5a82ce0c-0f2d-4d60-8fab-1aea51febd20 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:42.478114 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-5a82ce0c-0f2d-4d60-8fab-1aea51febd20 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:42.603107 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-5bfe673b-29b8-4c22-a7f6-23155b742ef9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:42.611471 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-5bfe673b-29b8-4c22-a7f6-23155b742ef9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:42.613575 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-5bfe673b-29b8-4c22-a7f6-23155b742ef9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:42.614720 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-5bfe673b-29b8-4c22-a7f6-23155b742ef9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1809 microversion: 2.20 time: 0.203872 Jan 18 16:33:42.615525 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 294/577] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:33:42 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1809 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:33:42.652221 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-5a82ce0c-0f2d-4d60-8fab-1aea51febd20 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0509d42df8844400b99d7c060ab98c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:42.662269 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-5a82ce0c-0f2d-4d60-8fab-1aea51febd20 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 200 len: 1358 microversion: 2.1 time: 0.198712 Jan 18 16:33:42.671592 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 284/578] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:42 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:33:42.778032 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-b81566ca-2fe5-40fd-a63f-ecdaa2101181 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:42.778681 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-b81566ca-2fe5-40fd-a63f-ecdaa2101181 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:42.786256 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-b81566ca-2fe5-40fd-a63f-ecdaa2101181 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:42.786785 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-b81566ca-2fe5-40fd-a63f-ecdaa2101181 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:42.787630 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-b81566ca-2fe5-40fd-a63f-ecdaa2101181 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:42.788073 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-b81566ca-2fe5-40fd-a63f-ecdaa2101181 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:42.930964 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-b81566ca-2fe5-40fd-a63f-ecdaa2101181 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:42.938387 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-b81566ca-2fe5-40fd-a63f-ecdaa2101181 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1520 microversion: 2.1 time: 0.164094 Jan 18 16:33:42.947728 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 295/579] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:42 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:43.180926 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-de97fb9a-f20b-4cf8-a84a-fb2b883b98ce tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:43.181445 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-de97fb9a-f20b-4cf8-a84a-fb2b883b98ce tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] [instance: 74592942-1569-4db1-bcdb-5f0cf97bea6e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:43.187189 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-de97fb9a-f20b-4cf8-a84a-fb2b883b98ce tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:43.187632 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-de97fb9a-f20b-4cf8-a84a-fb2b883b98ce tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:43.188402 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-de97fb9a-f20b-4cf8-a84a-fb2b883b98ce tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:43.188834 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-de97fb9a-f20b-4cf8-a84a-fb2b883b98ce tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:43.268127 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.objects.instance [None req-de97fb9a-f20b-4cf8-a84a-fb2b883b98ce tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lazy-loading 'services' on Instance uuid 74592942-1569-4db1-bcdb-5f0cf97bea6e {{(pid=116368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 18 16:33:43.336353 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-de97fb9a-f20b-4cf8-a84a-fb2b883b98ce tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] 10.222.0.82 "DELETE /compute/v2.1/servers/74592942-1569-4db1-bcdb-5f0cf97bea6e/os-volume_attachments/d95934c9-67f3-4ff8-a6bb-6d5c0ac5c816" status: 202 len: 0 microversion: 2.1 time: 0.158909 Jan 18 16:33:43.337012 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 285/580] 10.222.0.82 () {58 vars in 1415 bytes} [Tue Jan 18 16:33:43 2022] DELETE /compute/v2.1/servers/74592942-1569-4db1-bcdb-5f0cf97bea6e/os-volume_attachments/d95934c9-67f3-4ff8-a6bb-6d5c0ac5c816 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:33:43.632427 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-d3c9998e-31cf-4436-b749-1f220ca86d98 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:43.633079 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-d3c9998e-31cf-4436-b749-1f220ca86d98 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:43.639479 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-d3c9998e-31cf-4436-b749-1f220ca86d98 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:43.639933 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-d3c9998e-31cf-4436-b749-1f220ca86d98 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:43.640732 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-d3c9998e-31cf-4436-b749-1f220ca86d98 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:43.641197 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-d3c9998e-31cf-4436-b749-1f220ca86d98 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:43.680728 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-2664d331-67c2-4f06-84f6-5909a2008147 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:43.681493 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-2664d331-67c2-4f06-84f6-5909a2008147 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:43.687841 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-2664d331-67c2-4f06-84f6-5909a2008147 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:43.688252 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-2664d331-67c2-4f06-84f6-5909a2008147 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:43.689016 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-2664d331-67c2-4f06-84f6-5909a2008147 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:43.689593 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-2664d331-67c2-4f06-84f6-5909a2008147 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:43.813441 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-d3c9998e-31cf-4436-b749-1f220ca86d98 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:43.824195 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-d3c9998e-31cf-4436-b749-1f220ca86d98 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:43.826085 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-d3c9998e-31cf-4436-b749-1f220ca86d98 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:43.827855 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-d3c9998e-31cf-4436-b749-1f220ca86d98 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1809 microversion: 2.20 time: 0.200169 Jan 18 16:33:43.828422 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 296/581] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:33:43 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1809 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:33:43.867524 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-2664d331-67c2-4f06-84f6-5909a2008147 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0509d42df8844400b99d7c060ab98c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:43.877522 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-2664d331-67c2-4f06-84f6-5909a2008147 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 200 len: 1358 microversion: 2.1 time: 0.202344 Jan 18 16:33:43.879354 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 286/582] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:43 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 1358 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:33:43.955053 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-81e31eed-91e2-4a28-a40b-8765b1b50be8 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:43.955748 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-81e31eed-91e2-4a28-a40b-8765b1b50be8 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:43.961657 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-81e31eed-91e2-4a28-a40b-8765b1b50be8 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:43.962171 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-81e31eed-91e2-4a28-a40b-8765b1b50be8 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:43.963028 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-81e31eed-91e2-4a28-a40b-8765b1b50be8 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:43.963547 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-81e31eed-91e2-4a28-a40b-8765b1b50be8 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:44.118788 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-81e31eed-91e2-4a28-a40b-8765b1b50be8 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:44.129073 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-81e31eed-91e2-4a28-a40b-8765b1b50be8 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1520 microversion: 2.1 time: 0.177291 Jan 18 16:33:44.129796 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 297/583] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:43 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:44.408334 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [req-9b0e3776-1731-4338-bf42-86172d88a5fc req-ec56a88b-680d-4bee-84d8-8b4e23dfd7e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e9ca525-aad0-4ac6-8879-2c8d0131c2ee", "name": "network-vif-plugged", "status": "completed", "tag": "ca2a0420-8660-4c5a-8bc5-c3d7fa2913eb"}]} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:33:44.410318 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:33:44.410318 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: warnings.warn(msg) Jan 18 16:33:44.427806 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-9b0e3776-1731-4338-bf42-86172d88a5fc req-ec56a88b-680d-4bee-84d8-8b4e23dfd7e4 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:44.428271 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-9b0e3776-1731-4338-bf42-86172d88a5fc req-ec56a88b-680d-4bee-84d8-8b4e23dfd7e4 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:44.447380 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.compute.server_external_events [req-9b0e3776-1731-4338-bf42-86172d88a5fc req-ec56a88b-680d-4bee-84d8-8b4e23dfd7e4 service nova] Creating event network-vif-plugged:ca2a0420-8660-4c5a-8bc5-c3d7fa2913eb for instance 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee on hv-cinder-78836 Jan 18 16:33:44.461557 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [req-9b0e3776-1731-4338-bf42-86172d88a5fc req-ec56a88b-680d-4bee-84d8-8b4e23dfd7e4 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056969 Jan 18 16:33:44.462812 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 287/584] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:33:44.847072 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-8a5fd51c-9fbd-4c5f-b7b4-1bd5fe60c7ba tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:44.848322 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-8a5fd51c-9fbd-4c5f-b7b4-1bd5fe60c7ba tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:44.858873 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-8a5fd51c-9fbd-4c5f-b7b4-1bd5fe60c7ba tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:44.859597 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-8a5fd51c-9fbd-4c5f-b7b4-1bd5fe60c7ba tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:44.860416 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-8a5fd51c-9fbd-4c5f-b7b4-1bd5fe60c7ba tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:44.861094 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-8a5fd51c-9fbd-4c5f-b7b4-1bd5fe60c7ba tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:44.896951 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-4a2ef3ac-fc59-4ffb-a25f-092af4b6f231 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:44.902976 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-4a2ef3ac-fc59-4ffb-a25f-092af4b6f231 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:44.910371 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4a2ef3ac-fc59-4ffb-a25f-092af4b6f231 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:44.910749 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4a2ef3ac-fc59-4ffb-a25f-092af4b6f231 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:44.911813 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4a2ef3ac-fc59-4ffb-a25f-092af4b6f231 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:44.912517 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4a2ef3ac-fc59-4ffb-a25f-092af4b6f231 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:45.173388 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-4a2ef3ac-fc59-4ffb-a25f-092af4b6f231 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0509d42df8844400b99d7c060ab98c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:45.179557 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-8a5fd51c-9fbd-4c5f-b7b4-1bd5fe60c7ba tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:45.186358 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-4a2ef3ac-fc59-4ffb-a25f-092af4b6f231 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 200 len: 1358 microversion: 2.1 time: 0.294902 Jan 18 16:33:45.187227 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 288/585] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:44 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 1358 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:33:45.192430 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-3e0f2845-ecde-43a4-9a56-91f99378479f tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:45.193226 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-3e0f2845-ecde-43a4-9a56-91f99378479f tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:45.200425 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-8a5fd51c-9fbd-4c5f-b7b4-1bd5fe60c7ba tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:45.200799 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3e0f2845-ecde-43a4-9a56-91f99378479f tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:45.201436 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3e0f2845-ecde-43a4-9a56-91f99378479f tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:45.201938 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-8a5fd51c-9fbd-4c5f-b7b4-1bd5fe60c7ba tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:45.202453 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3e0f2845-ecde-43a4-9a56-91f99378479f tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:45.202892 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3e0f2845-ecde-43a4-9a56-91f99378479f tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:45.203480 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-8a5fd51c-9fbd-4c5f-b7b4-1bd5fe60c7ba tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1809 microversion: 2.20 time: 0.360175 Jan 18 16:33:45.204172 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 298/586] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:33:44 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1809 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:33:45.355596 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-3e0f2845-ecde-43a4-9a56-91f99378479f tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:45.363358 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-3e0f2845-ecde-43a4-9a56-91f99378479f tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1520 microversion: 2.1 time: 0.174752 Jan 18 16:33:45.364051 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 289/587] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:45 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:45.531433 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-5ce5c8f9-b545-496a-b9a1-f670134063f6 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:45.532316 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-5ce5c8f9-b545-496a-b9a1-f670134063f6 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] [instance: 74592942-1569-4db1-bcdb-5f0cf97bea6e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:45.544102 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-5ce5c8f9-b545-496a-b9a1-f670134063f6 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:45.544936 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-5ce5c8f9-b545-496a-b9a1-f670134063f6 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:45.545945 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-5ce5c8f9-b545-496a-b9a1-f670134063f6 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:45.546596 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-5ce5c8f9-b545-496a-b9a1-f670134063f6 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:45.573253 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-5ce5c8f9-b545-496a-b9a1-f670134063f6 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] [instance: 74592942-1569-4db1-bcdb-5f0cf97bea6e] Going to try to terminate instance {{(pid=116367) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 18 16:33:45.670624 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-5ce5c8f9-b545-496a-b9a1-f670134063f6 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] 10.222.0.82 "DELETE /compute/v2.1/servers/74592942-1569-4db1-bcdb-5f0cf97bea6e" status: 204 len: 0 microversion: 2.1 time: 0.142584 Jan 18 16:33:45.672820 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 299/588] 10.222.0.82 () {58 vars in 1238 bytes} [Tue Jan 18 16:33:45 2022] DELETE /compute/v2.1/servers/74592942-1569-4db1-bcdb-5f0cf97bea6e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 18 16:33:45.686843 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-20fe9718-0272-4984-9a43-6b135acf8d44 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:45.688893 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-20fe9718-0272-4984-9a43-6b135acf8d44 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] [instance: 74592942-1569-4db1-bcdb-5f0cf97bea6e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:45.696728 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-20fe9718-0272-4984-9a43-6b135acf8d44 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:45.698471 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-20fe9718-0272-4984-9a43-6b135acf8d44 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:45.699679 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-20fe9718-0272-4984-9a43-6b135acf8d44 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:45.700119 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-20fe9718-0272-4984-9a43-6b135acf8d44 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:45.869612 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-20fe9718-0272-4984-9a43-6b135acf8d44 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbc235b02424200b625af5b9995bbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417f505277c847cf9b6aaf89f1639bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:45.877275 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-20fe9718-0272-4984-9a43-6b135acf8d44 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] 10.222.0.82 "GET /compute/v2.1/servers/74592942-1569-4db1-bcdb-5f0cf97bea6e" status: 200 len: 1513 microversion: 2.1 time: 0.199029 Jan 18 16:33:45.880959 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 290/589] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:45 2022] GET /compute/v2.1/servers/74592942-1569-4db1-bcdb-5f0cf97bea6e => generated 1513 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:46.077337 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [req-0c4c7e48-66e5-4cbc-93b9-804974266940 req-7fb1dcfe-b0cd-41b0-b67e-b0ec0b834ccd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c862639d-6995-43e1-9c7a-3d4f416629fc", "name": "network-vif-deleted", "tag": "26efc157-2c4a-47a9-adb9-526b31015bd6"}]} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:33:46.079018 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:33:46.079018 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: warnings.warn(msg) Jan 18 16:33:46.104538 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-0c4c7e48-66e5-4cbc-93b9-804974266940 req-7fb1dcfe-b0cd-41b0-b67e-b0ec0b834ccd service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:46.106099 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-0c4c7e48-66e5-4cbc-93b9-804974266940 req-7fb1dcfe-b0cd-41b0-b67e-b0ec0b834ccd service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:46.121684 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.compute.server_external_events [req-0c4c7e48-66e5-4cbc-93b9-804974266940 req-7fb1dcfe-b0cd-41b0-b67e-b0ec0b834ccd service nova] Creating event network-vif-deleted:26efc157-2c4a-47a9-adb9-526b31015bd6 for instance c862639d-6995-43e1-9c7a-3d4f416629fc on hv-cinder-78836 Jan 18 16:33:46.131418 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [req-0c4c7e48-66e5-4cbc-93b9-804974266940 req-7fb1dcfe-b0cd-41b0-b67e-b0ec0b834ccd service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058236 Jan 18 16:33:46.132297 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 300/590] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 16:33:46.203292 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-22466830-621e-4df5-aca4-3e565de725d1 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:46.203907 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-22466830-621e-4df5-aca4-3e565de725d1 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:46.211400 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-22466830-621e-4df5-aca4-3e565de725d1 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:46.211890 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-22466830-621e-4df5-aca4-3e565de725d1 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:46.212880 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-22466830-621e-4df5-aca4-3e565de725d1 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:46.213356 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-22466830-621e-4df5-aca4-3e565de725d1 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:46.226327 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-8b5e3226-a8bc-437d-981d-db36346e37c3 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:46.227868 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-8b5e3226-a8bc-437d-981d-db36346e37c3 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:46.237331 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-8b5e3226-a8bc-437d-981d-db36346e37c3 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:46.238081 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-8b5e3226-a8bc-437d-981d-db36346e37c3 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:46.239129 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-8b5e3226-a8bc-437d-981d-db36346e37c3 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:46.239795 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-8b5e3226-a8bc-437d-981d-db36346e37c3 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:46.482959 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-22466830-621e-4df5-aca4-3e565de725d1 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0509d42df8844400b99d7c060ab98c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:46.486497 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-8b5e3226-a8bc-437d-981d-db36346e37c3 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:46.490428 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-22466830-621e-4df5-aca4-3e565de725d1 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 200 len: 1358 microversion: 2.1 time: 0.290784 Jan 18 16:33:46.490994 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 291/591] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:46 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 1358 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:46.495288 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-8b5e3226-a8bc-437d-981d-db36346e37c3 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:46.496936 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-8b5e3226-a8bc-437d-981d-db36346e37c3 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:46.497934 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-73ecf6f2-0d93-4e25-9988-90cedb872fe3 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:46.498231 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-8b5e3226-a8bc-437d-981d-db36346e37c3 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1809 microversion: 2.20 time: 0.277664 Jan 18 16:33:46.498673 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-73ecf6f2-0d93-4e25-9988-90cedb872fe3 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:46.498907 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 301/592] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:33:46 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1809 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 16:33:46.505657 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-73ecf6f2-0d93-4e25-9988-90cedb872fe3 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:46.506180 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-73ecf6f2-0d93-4e25-9988-90cedb872fe3 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:46.507029 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-73ecf6f2-0d93-4e25-9988-90cedb872fe3 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:46.507490 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-73ecf6f2-0d93-4e25-9988-90cedb872fe3 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:46.515582 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [req-a7348f35-ba6f-44e7-bf28-cb5713e05a18 req-f1521460-b4f2-430e-bc00-34cfd67d8890 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "218c4c12-4e16-4dc9-8519-bcef764f01c6", "name": "network-vif-plugged", "status": "completed", "tag": "684a69e2-8aee-429a-ad20-cba1e94ddb16"}]} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:33:46.517504 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:33:46.517504 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: warnings.warn(msg) Jan 18 16:33:46.533815 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-a7348f35-ba6f-44e7-bf28-cb5713e05a18 req-f1521460-b4f2-430e-bc00-34cfd67d8890 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:46.536829 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-a7348f35-ba6f-44e7-bf28-cb5713e05a18 req-f1521460-b4f2-430e-bc00-34cfd67d8890 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:46.543721 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-73ecf6f2-0d93-4e25-9988-90cedb872fe3 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:46.544144 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-73ecf6f2-0d93-4e25-9988-90cedb872fe3 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:46.544594 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.objects.instance [None req-73ecf6f2-0d93-4e25-9988-90cedb872fe3 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lazy-loading 'fault' on Instance uuid c862639d-6995-43e1-9c7a-3d4f416629fc {{(pid=116368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 18 16:33:46.557539 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.compute.server_external_events [req-a7348f35-ba6f-44e7-bf28-cb5713e05a18 req-f1521460-b4f2-430e-bc00-34cfd67d8890 service nova] Creating event network-vif-plugged:684a69e2-8aee-429a-ad20-cba1e94ddb16 for instance 218c4c12-4e16-4dc9-8519-bcef764f01c6 on hv-cinder-78836 Jan 18 16:33:46.564015 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [req-a7348f35-ba6f-44e7-bf28-cb5713e05a18 req-f1521460-b4f2-430e-bc00-34cfd67d8890 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062307 Jan 18 16:33:46.565285 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 302/593] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:33:46.598379 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-73ecf6f2-0d93-4e25-9988-90cedb872fe3 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fc361080dd4249836a7427667d358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4e8303945cd884f4f15c31f0c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:46.607026 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-73ecf6f2-0d93-4e25-9988-90cedb872fe3 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 200 len: 1311 microversion: 2.1 time: 0.115053 Jan 18 16:33:46.608126 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 292/594] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:46 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 1311 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:46.899714 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-52a318a0-8943-4c9d-acc8-198fb2a13ff5 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:46.901879 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-52a318a0-8943-4c9d-acc8-198fb2a13ff5 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] [instance: 74592942-1569-4db1-bcdb-5f0cf97bea6e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:46.923043 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-52a318a0-8943-4c9d-acc8-198fb2a13ff5 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:46.923520 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-52a318a0-8943-4c9d-acc8-198fb2a13ff5 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:46.924390 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-52a318a0-8943-4c9d-acc8-198fb2a13ff5 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:46.933202 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-52a318a0-8943-4c9d-acc8-198fb2a13ff5 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:47.142585 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-52a318a0-8943-4c9d-acc8-198fb2a13ff5 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbc235b02424200b625af5b9995bbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417f505277c847cf9b6aaf89f1639bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:47.151534 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-52a318a0-8943-4c9d-acc8-198fb2a13ff5 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] 10.222.0.82 "GET /compute/v2.1/servers/74592942-1569-4db1-bcdb-5f0cf97bea6e" status: 200 len: 1513 microversion: 2.1 time: 0.259495 Jan 18 16:33:47.163457 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 303/595] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:46 2022] GET /compute/v2.1/servers/74592942-1569-4db1-bcdb-5f0cf97bea6e => generated 1513 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:47.508419 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-0d7f4d89-7410-4eee-9c69-52f9372a7377 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:47.510038 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-0d7f4d89-7410-4eee-9c69-52f9372a7377 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:47.517925 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-a860af5a-b119-4ceb-848c-e1a4bfbc85b7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:47.519049 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-a860af5a-b119-4ceb-848c-e1a4bfbc85b7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:47.528246 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a860af5a-b119-4ceb-848c-e1a4bfbc85b7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:47.530577 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a860af5a-b119-4ceb-848c-e1a4bfbc85b7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:47.531587 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a860af5a-b119-4ceb-848c-e1a4bfbc85b7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:47.532849 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0d7f4d89-7410-4eee-9c69-52f9372a7377 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:47.533564 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a860af5a-b119-4ceb-848c-e1a4bfbc85b7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:47.534315 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0d7f4d89-7410-4eee-9c69-52f9372a7377 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:47.538313 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0d7f4d89-7410-4eee-9c69-52f9372a7377 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:47.539542 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0d7f4d89-7410-4eee-9c69-52f9372a7377 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:47.791999 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-a860af5a-b119-4ceb-848c-e1a4bfbc85b7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:47.794847 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-0d7f4d89-7410-4eee-9c69-52f9372a7377 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0509d42df8844400b99d7c060ab98c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:47.803746 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-0d7f4d89-7410-4eee-9c69-52f9372a7377 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 200 len: 1358 microversion: 2.1 time: 0.299712 Jan 18 16:33:47.813285 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 293/596] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:47 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 1358 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:47.814144 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-a860af5a-b119-4ceb-848c-e1a4bfbc85b7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:47.819499 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-b0024639-040a-406f-b0fc-199ef2c219e6 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:47.820390 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-b0024639-040a-406f-b0fc-199ef2c219e6 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] [instance: c862639d-6995-43e1-9c7a-3d4f416629fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:47.820875 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-a860af5a-b119-4ceb-848c-e1a4bfbc85b7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:47.822565 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-a860af5a-b119-4ceb-848c-e1a4bfbc85b7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1809 microversion: 2.20 time: 0.308511 Jan 18 16:33:47.823309 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 304/597] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:33:47 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1809 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:33:47.839256 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-b0024639-040a-406f-b0fc-199ef2c219e6 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:47.840368 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-b0024639-040a-406f-b0fc-199ef2c219e6 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:47.841402 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-b0024639-040a-406f-b0fc-199ef2c219e6 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:47.842034 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-b0024639-040a-406f-b0fc-199ef2c219e6 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:47.864208 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.wsgi [None req-b0024639-040a-406f-b0fc-199ef2c219e6 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] HTTP exception thrown: Instance c862639d-6995-43e1-9c7a-3d4f416629fc could not be found. Jan 18 16:33:47.865191 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-b0024639-040a-406f-b0fc-199ef2c219e6 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] Returning 404 to user: Instance c862639d-6995-43e1-9c7a-3d4f416629fc could not be found. {{(pid=116368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 16:33:47.866189 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-b0024639-040a-406f-b0fc-199ef2c219e6 tempest-ServerRescueNegativeTestJSON-1403295012 tempest-ServerRescueNegativeTestJSON-1403295012-project] 10.222.0.82 "GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc" status: 404 len: 111 microversion: 2.1 time: 0.051355 Jan 18 16:33:47.867257 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 294/598] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:47 2022] GET /compute/v2.1/servers/c862639d-6995-43e1-9c7a-3d4f416629fc => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 16:33:48.170844 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-bb20c71c-7695-44ee-b731-6257c3761d99 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:48.172414 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-bb20c71c-7695-44ee-b731-6257c3761d99 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] [instance: 74592942-1569-4db1-bcdb-5f0cf97bea6e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:48.180770 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-bb20c71c-7695-44ee-b731-6257c3761d99 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:48.181613 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-bb20c71c-7695-44ee-b731-6257c3761d99 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:48.182787 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-bb20c71c-7695-44ee-b731-6257c3761d99 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:48.183396 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-bb20c71c-7695-44ee-b731-6257c3761d99 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:48.441360 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-bb20c71c-7695-44ee-b731-6257c3761d99 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbc235b02424200b625af5b9995bbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417f505277c847cf9b6aaf89f1639bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:48.446501 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-bb20c71c-7695-44ee-b731-6257c3761d99 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] 10.222.0.82 "GET /compute/v2.1/servers/74592942-1569-4db1-bcdb-5f0cf97bea6e" status: 200 len: 1513 microversion: 2.1 time: 0.279437 Jan 18 16:33:48.447411 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 305/599] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:48 2022] GET /compute/v2.1/servers/74592942-1569-4db1-bcdb-5f0cf97bea6e => generated 1513 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:33:48.823379 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-1a8a408b-a17b-481c-aa1e-7f5dbb4cfa83 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:48.824465 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-1a8a408b-a17b-481c-aa1e-7f5dbb4cfa83 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:48.848090 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-6cfd873c-b262-403e-8f75-9a63da9c4f8f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:48.848961 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-6cfd873c-b262-403e-8f75-9a63da9c4f8f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:48.856766 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1a8a408b-a17b-481c-aa1e-7f5dbb4cfa83 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:48.861641 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1a8a408b-a17b-481c-aa1e-7f5dbb4cfa83 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:48.862910 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6cfd873c-b262-403e-8f75-9a63da9c4f8f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:48.864889 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6cfd873c-b262-403e-8f75-9a63da9c4f8f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:48.865380 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1a8a408b-a17b-481c-aa1e-7f5dbb4cfa83 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:48.865695 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6cfd873c-b262-403e-8f75-9a63da9c4f8f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:48.866209 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6cfd873c-b262-403e-8f75-9a63da9c4f8f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:48.867204 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1a8a408b-a17b-481c-aa1e-7f5dbb4cfa83 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:49.267727 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-6cfd873c-b262-403e-8f75-9a63da9c4f8f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:49.272454 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-1a8a408b-a17b-481c-aa1e-7f5dbb4cfa83 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0509d42df8844400b99d7c060ab98c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:49.280828 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-1a8a408b-a17b-481c-aa1e-7f5dbb4cfa83 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 200 len: 1548 microversion: 2.1 time: 0.464387 Jan 18 16:33:49.282270 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-6cfd873c-b262-403e-8f75-9a63da9c4f8f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:49.283774 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-6cfd873c-b262-403e-8f75-9a63da9c4f8f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:49.286200 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-6cfd873c-b262-403e-8f75-9a63da9c4f8f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1796 microversion: 2.20 time: 0.448980 Jan 18 16:33:49.286919 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 306/600] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:33:48 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1796 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:33:49.292200 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [req-48c202e2-2747-4e3f-bfa3-33b15a816ffe req-6a2de8ff-2d78-4407-b917-2f0cd1a95dad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74592942-1569-4db1-bcdb-5f0cf97bea6e", "name": "network-vif-deleted", "tag": "5ab2fdd2-12ac-4769-9cb1-77cabf1c426b"}]} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:33:49.293967 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:33:49.293967 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: warnings.warn(msg) Jan 18 16:33:49.298431 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 295/601] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:48 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 1548 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:33:49.313100 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-e57c1af1-4012-40b9-b623-a5e85ec65460 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:49.314573 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-e57c1af1-4012-40b9-b623-a5e85ec65460 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:49.323436 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e57c1af1-4012-40b9-b623-a5e85ec65460 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:49.324112 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e57c1af1-4012-40b9-b623-a5e85ec65460 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:49.325460 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e57c1af1-4012-40b9-b623-a5e85ec65460 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:49.326337 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e57c1af1-4012-40b9-b623-a5e85ec65460 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:49.350214 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-48c202e2-2747-4e3f-bfa3-33b15a816ffe req-6a2de8ff-2d78-4407-b917-2f0cd1a95dad service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:49.354271 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-48c202e2-2747-4e3f-bfa3-33b15a816ffe req-6a2de8ff-2d78-4407-b917-2f0cd1a95dad service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:49.366840 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.compute.server_external_events [req-48c202e2-2747-4e3f-bfa3-33b15a816ffe req-6a2de8ff-2d78-4407-b917-2f0cd1a95dad service nova] Creating event network-vif-deleted:5ab2fdd2-12ac-4769-9cb1-77cabf1c426b for instance 74592942-1569-4db1-bcdb-5f0cf97bea6e on hv-cinder-78836 Jan 18 16:33:49.371987 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [req-48c202e2-2747-4e3f-bfa3-33b15a816ffe req-6a2de8ff-2d78-4407-b917-2f0cd1a95dad service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083240 Jan 18 16:33:49.373196 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 307/602] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:33:49.477005 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-6c9a4baf-1c1d-4b40-93ba-85d61ed858f9 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:49.477990 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-6c9a4baf-1c1d-4b40-93ba-85d61ed858f9 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] [instance: 74592942-1569-4db1-bcdb-5f0cf97bea6e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:49.489377 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6c9a4baf-1c1d-4b40-93ba-85d61ed858f9 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:49.489854 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6c9a4baf-1c1d-4b40-93ba-85d61ed858f9 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:49.490688 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6c9a4baf-1c1d-4b40-93ba-85d61ed858f9 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:49.491175 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6c9a4baf-1c1d-4b40-93ba-85d61ed858f9 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:49.525497 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6c9a4baf-1c1d-4b40-93ba-85d61ed858f9 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:49.525884 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6c9a4baf-1c1d-4b40-93ba-85d61ed858f9 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:49.526351 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.objects.instance [None req-6c9a4baf-1c1d-4b40-93ba-85d61ed858f9 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lazy-loading 'fault' on Instance uuid 74592942-1569-4db1-bcdb-5f0cf97bea6e {{(pid=116367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 18 16:33:49.585716 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-6c9a4baf-1c1d-4b40-93ba-85d61ed858f9 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbc235b02424200b625af5b9995bbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417f505277c847cf9b6aaf89f1639bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:49.592826 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-e57c1af1-4012-40b9-b623-a5e85ec65460 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0509d42df8844400b99d7c060ab98c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:49.594341 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-6c9a4baf-1c1d-4b40-93ba-85d61ed858f9 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] 10.222.0.82 "GET /compute/v2.1/servers/74592942-1569-4db1-bcdb-5f0cf97bea6e" status: 200 len: 1309 microversion: 2.1 time: 0.122605 Jan 18 16:33:49.595430 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 308/603] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:49 2022] GET /compute/v2.1/servers/74592942-1569-4db1-bcdb-5f0cf97bea6e => generated 1309 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:33:49.605270 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-e57c1af1-4012-40b9-b623-a5e85ec65460 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 200 len: 1548 microversion: 2.1 time: 0.305442 Jan 18 16:33:49.607061 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 296/604] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:49 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 1548 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:49.623101 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-852877af-37c0-4127-9a7d-545a148b7f76 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:49.626679 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:33:49.626679 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: warnings.warn(msg) Jan 18 16:33:49.627766 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-852877af-37c0-4127-9a7d-545a148b7f76 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0509d42df8844400b99d7c060ab98c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:49.629027 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-852877af-37c0-4127-9a7d-545a148b7f76 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Searching by: {'deleted': False, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20'} {{(pid=116367) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 18 16:33:49.635681 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-852877af-37c0-4127-9a7d-545a148b7f76 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:49.636314 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-852877af-37c0-4127-9a7d-545a148b7f76 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:49.637418 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-852877af-37c0-4127-9a7d-545a148b7f76 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:49.638037 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-852877af-37c0-4127-9a7d-545a148b7f76 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:49.764157 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.multi_cell_list [None req-852877af-37c0-4127-9a7d-545a148b7f76 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116367) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 18 16:33:49.884984 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-852877af-37c0-4127-9a7d-545a148b7f76 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.265679 Jan 18 16:33:49.885973 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 309/605] 10.222.0.82 () {58 vars in 1124 bytes} [Tue Jan 18 16:33:49 2022] GET /compute/v2.1/servers => generated 342 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:33:49.896351 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-3bf2ec3c-4725-41a7-b8a9-910a0e13dfb4 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:49.897855 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-3bf2ec3c-4725-41a7-b8a9-910a0e13dfb4 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:49.904557 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3bf2ec3c-4725-41a7-b8a9-910a0e13dfb4 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:49.905387 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3bf2ec3c-4725-41a7-b8a9-910a0e13dfb4 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:49.906511 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3bf2ec3c-4725-41a7-b8a9-910a0e13dfb4 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:49.907152 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3bf2ec3c-4725-41a7-b8a9-910a0e13dfb4 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:50.335201 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-3bf2ec3c-4725-41a7-b8a9-910a0e13dfb4 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0509d42df8844400b99d7c060ab98c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:50.343449 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-3bf2ec3c-4725-41a7-b8a9-910a0e13dfb4 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 200 len: 1548 microversion: 2.1 time: 0.451243 Jan 18 16:33:50.353711 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 297/606] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:49 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 1548 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:50.622942 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-cea888f7-ee7b-410b-a064-8190d0d87ea2 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:50.624533 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-cea888f7-ee7b-410b-a064-8190d0d87ea2 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] [instance: 74592942-1569-4db1-bcdb-5f0cf97bea6e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:50.634987 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-cea888f7-ee7b-410b-a064-8190d0d87ea2 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:50.647332 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-cea888f7-ee7b-410b-a064-8190d0d87ea2 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:50.653067 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-cea888f7-ee7b-410b-a064-8190d0d87ea2 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:50.653911 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-cea888f7-ee7b-410b-a064-8190d0d87ea2 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:50.696839 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.wsgi [None req-cea888f7-ee7b-410b-a064-8190d0d87ea2 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] HTTP exception thrown: Instance 74592942-1569-4db1-bcdb-5f0cf97bea6e could not be found. Jan 18 16:33:50.697476 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-cea888f7-ee7b-410b-a064-8190d0d87ea2 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Returning 404 to user: Instance 74592942-1569-4db1-bcdb-5f0cf97bea6e could not be found. {{(pid=116367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 16:33:50.698314 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-cea888f7-ee7b-410b-a064-8190d0d87ea2 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] 10.222.0.82 "GET /compute/v2.1/servers/74592942-1569-4db1-bcdb-5f0cf97bea6e" status: 404 len: 111 microversion: 2.1 time: 0.089523 Jan 18 16:33:50.698867 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 310/607] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:50 2022] GET /compute/v2.1/servers/74592942-1569-4db1-bcdb-5f0cf97bea6e => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 16:33:52.058844 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-150ec568-0b3c-4f58-943b-35fd398af1ae tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61bfb964-aa2a-4025-a27c-b45927b538bb"}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:33:52.060099 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-150ec568-0b3c-4f58-943b-35fd398af1ae tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:52.068527 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-150ec568-0b3c-4f58-943b-35fd398af1ae tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:52.069171 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-150ec568-0b3c-4f58-943b-35fd398af1ae tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:52.070040 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-150ec568-0b3c-4f58-943b-35fd398af1ae tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:52.070543 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-150ec568-0b3c-4f58-943b-35fd398af1ae tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:54.684523 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-150ec568-0b3c-4f58-943b-35fd398af1ae tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "POST /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.629775 Jan 18 16:33:54.689825 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 298/608] 10.222.0.82 () {60 vars in 1322 bytes} [Tue Jan 18 16:33:52 2022] POST /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6/os-volume_attachments => generated 194 bytes in 2636 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:33:55.606893 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-2fd08f6a-5fa2-4964-8791-e1b36bea4829 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-954365399", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-248830851", "security_groups": [{"name": "tempest-secgroup-smoke-1092520296"}], "networks": [{"uuid": "1d779339-63eb-450d-a363-4b07209eeb29"}], "block_device_mapping_v2": [{"uuid": "d6298d71-77f9-402d-9638-924cccce2410", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:33:55.746636 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.network.neutron [None req-2fd08f6a-5fa2-4964-8791-e1b36bea4829 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] validate_networks() for [('1d779339-63eb-450d-a363-4b07209eeb29', None, None, None, None, None)] {{(pid=116367) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 18 16:33:56.289960 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.virt.hardware [None req-2fd08f6a-5fa2-4964-8791-e1b36bea4829 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Flavor limits 0:0:0 {{(pid=116367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 18 16:33:56.290664 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.virt.hardware [None req-2fd08f6a-5fa2-4964-8791-e1b36bea4829 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Image limits 0:0:0 {{(pid=116367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 18 16:33:56.291146 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.virt.hardware [None req-2fd08f6a-5fa2-4964-8791-e1b36bea4829 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Flavor pref 0:0:0 {{(pid=116367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 18 16:33:56.291575 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.virt.hardware [None req-2fd08f6a-5fa2-4964-8791-e1b36bea4829 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Image pref 0:0:0 {{(pid=116367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 18 16:33:56.292783 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.virt.hardware [None req-2fd08f6a-5fa2-4964-8791-e1b36bea4829 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 18 16:33:56.307219 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2fd08f6a-5fa2-4964-8791-e1b36bea4829 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:56.318025 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2fd08f6a-5fa2-4964-8791-e1b36bea4829 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:56.319248 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2fd08f6a-5fa2-4964-8791-e1b36bea4829 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:56.320105 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2fd08f6a-5fa2-4964-8791-e1b36bea4829 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:56.366622 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.quota [None req-2fd08f6a-5fa2-4964-8791-e1b36bea4829 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Getting quotas for project 726b7bab53ef4d6e869362551b3cfb6c. Resources: {'ram', 'instances', 'cores'} {{(pid=116367) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 16:33:56.371711 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.quota [None req-2fd08f6a-5fa2-4964-8791-e1b36bea4829 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Getting quotas for user 8a2d1245fe3f4bf596e1c0f6978e34bd and project 726b7bab53ef4d6e869362551b3cfb6c. Resources: {'ram', 'instances', 'cores'} {{(pid=116367) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 16:33:56.446608 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-2fd08f6a-5fa2-4964-8791-e1b36bea4829 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Going to run 1 instances... {{(pid=116367) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 18 16:33:56.449153 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-2fd08f6a-5fa2-4964-8791-e1b36bea4829 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] [instance: d5f46b70-ff39-46b9-912c-206b0683ed70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d6298d71-77f9-402d-9638-924cccce2410',volume_size=None,volume_type=None)] {{(pid=116367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 18 16:33:56.692496 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-2fd08f6a-5fa2-4964-8791-e1b36bea4829 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.089265 Jan 18 16:33:56.694362 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 311/609] 10.222.0.82 () {60 vars in 1146 bytes} [Tue Jan 18 16:33:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 1092 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 18 16:33:56.706255 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-bc4be2ef-4199-4e5f-b7ba-625a1fddc941 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:56.706953 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-bc4be2ef-4199-4e5f-b7ba-625a1fddc941 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] [instance: d5f46b70-ff39-46b9-912c-206b0683ed70] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:56.814777 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-bc4be2ef-4199-4e5f-b7ba-625a1fddc941 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2d1245fe3f4bf596e1c0f6978e34bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b7bab53ef4d6e869362551b3cfb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:56.825808 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-bc4be2ef-4199-4e5f-b7ba-625a1fddc941 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] 10.222.0.82 "GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70" status: 200 len: 1087 microversion: 2.1 time: 0.125052 Jan 18 16:33:56.839561 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 299/610] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:56 2022] GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70 => generated 1087 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:57.844878 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-2db6fe57-7df5-4975-9b46-e57f9daacd51 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:57.846166 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-2db6fe57-7df5-4975-9b46-e57f9daacd51 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] [instance: d5f46b70-ff39-46b9-912c-206b0683ed70] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:57.852626 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2db6fe57-7df5-4975-9b46-e57f9daacd51 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:57.853213 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2db6fe57-7df5-4975-9b46-e57f9daacd51 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:57.854091 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2db6fe57-7df5-4975-9b46-e57f9daacd51 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:57.854982 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2db6fe57-7df5-4975-9b46-e57f9daacd51 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:57.926783 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-2db6fe57-7df5-4975-9b46-e57f9daacd51 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2d1245fe3f4bf596e1c0f6978e34bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b7bab53ef4d6e869362551b3cfb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:57.935759 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-2db6fe57-7df5-4975-9b46-e57f9daacd51 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] 10.222.0.82 "GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70" status: 200 len: 1137 microversion: 2.1 time: 0.095521 Jan 18 16:33:57.936489 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 312/611] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:57 2022] GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70 => generated 1137 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:33:58.956582 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-4d0078ab-81bd-46f1-b106-8e3ce0532dc1 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:33:58.957265 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-4d0078ab-81bd-46f1-b106-8e3ce0532dc1 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] [instance: d5f46b70-ff39-46b9-912c-206b0683ed70] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:33:58.972538 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4d0078ab-81bd-46f1-b106-8e3ce0532dc1 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:58.973047 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4d0078ab-81bd-46f1-b106-8e3ce0532dc1 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:58.974065 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4d0078ab-81bd-46f1-b106-8e3ce0532dc1 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:33:58.974678 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4d0078ab-81bd-46f1-b106-8e3ce0532dc1 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:33:59.055104 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-4d0078ab-81bd-46f1-b106-8e3ce0532dc1 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2d1245fe3f4bf596e1c0f6978e34bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b7bab53ef4d6e869362551b3cfb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:33:59.063290 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-4d0078ab-81bd-46f1-b106-8e3ce0532dc1 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] 10.222.0.82 "GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70" status: 200 len: 1137 microversion: 2.1 time: 0.111250 Jan 18 16:33:59.066801 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 300/612] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:33:58 2022] GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70 => generated 1137 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:34:00.089376 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-7f4e349c-62c9-4847-ba2b-276f7b0a0989 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:00.090668 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-7f4e349c-62c9-4847-ba2b-276f7b0a0989 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] [instance: d5f46b70-ff39-46b9-912c-206b0683ed70] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:00.105966 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7f4e349c-62c9-4847-ba2b-276f7b0a0989 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:00.106626 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7f4e349c-62c9-4847-ba2b-276f7b0a0989 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:00.108221 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7f4e349c-62c9-4847-ba2b-276f7b0a0989 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:00.108698 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7f4e349c-62c9-4847-ba2b-276f7b0a0989 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:00.201878 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-7f4e349c-62c9-4847-ba2b-276f7b0a0989 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2d1245fe3f4bf596e1c0f6978e34bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b7bab53ef4d6e869362551b3cfb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:00.210931 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-7f4e349c-62c9-4847-ba2b-276f7b0a0989 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] 10.222.0.82 "GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70" status: 200 len: 1185 microversion: 2.1 time: 0.131285 Jan 18 16:34:00.212014 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 313/613] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:34:00 2022] GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70 => generated 1185 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:34:01.073420 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-d3034a06-408d-4314-ab89-3dfc608e5e9e tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1989496748", "imageRef": "900c4a9d-b6c6-451f-a509-eb4f4b49f459", "flavorRef": "452", "networks": [{"uuid": "304974be-1692-42d6-8f0c-22abd422d9d8"}]}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:34:01.176358 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.network.neutron [None req-d3034a06-408d-4314-ab89-3dfc608e5e9e tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] validate_networks() for [('304974be-1692-42d6-8f0c-22abd422d9d8', None, None, None, None, None)] {{(pid=116368) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 18 16:34:01.228367 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-c1806480-d23e-4255-a4dc-0383e369d918 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:01.229661 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-c1806480-d23e-4255-a4dc-0383e369d918 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] [instance: d5f46b70-ff39-46b9-912c-206b0683ed70] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:01.244023 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c1806480-d23e-4255-a4dc-0383e369d918 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:01.245600 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c1806480-d23e-4255-a4dc-0383e369d918 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:01.248425 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c1806480-d23e-4255-a4dc-0383e369d918 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:01.249169 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c1806480-d23e-4255-a4dc-0383e369d918 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:01.383190 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-c1806480-d23e-4255-a4dc-0383e369d918 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2d1245fe3f4bf596e1c0f6978e34bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b7bab53ef4d6e869362551b3cfb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:01.392992 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-c1806480-d23e-4255-a4dc-0383e369d918 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] 10.222.0.82 "GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70" status: 200 len: 1203 microversion: 2.1 time: 0.168217 Jan 18 16:34:01.398406 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 314/614] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:34:01 2022] GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70 => generated 1203 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:34:01.934821 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-d3034a06-408d-4314-ab89-3dfc608e5e9e tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Flavor limits 0:0:0 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 18 16:34:01.935167 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-d3034a06-408d-4314-ab89-3dfc608e5e9e tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Image limits 0:0:0 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 18 16:34:01.935614 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-d3034a06-408d-4314-ab89-3dfc608e5e9e tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Flavor pref 0:0:0 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 18 16:34:01.936015 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-d3034a06-408d-4314-ab89-3dfc608e5e9e tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Image pref 0:0:0 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 18 16:34:01.936418 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-d3034a06-408d-4314-ab89-3dfc608e5e9e tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 18 16:34:01.960029 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d3034a06-408d-4314-ab89-3dfc608e5e9e tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:01.961593 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d3034a06-408d-4314-ab89-3dfc608e5e9e tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:01.963096 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d3034a06-408d-4314-ab89-3dfc608e5e9e tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:01.963672 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d3034a06-408d-4314-ab89-3dfc608e5e9e tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:01.991827 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.quota [None req-d3034a06-408d-4314-ab89-3dfc608e5e9e tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Getting quotas for project 417f505277c847cf9b6aaf89f1639bff. Resources: {'ram', 'instances', 'cores'} {{(pid=116368) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 16:34:01.997070 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.quota [None req-d3034a06-408d-4314-ab89-3dfc608e5e9e tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Getting quotas for user ebbc235b02424200b625af5b9995bbdb and project 417f505277c847cf9b6aaf89f1639bff. Resources: {'ram', 'instances', 'cores'} {{(pid=116368) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 16:34:02.015362 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-d3034a06-408d-4314-ab89-3dfc608e5e9e tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Going to run 1 instances... {{(pid=116368) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 18 16:34:02.018945 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-d3034a06-408d-4314-ab89-3dfc608e5e9e tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] [instance: 17780bc8-43cc-4572-81bc-e15bfcc81035] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='900c4a9d-b6c6-451f-a509-eb4f4b49f459',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116368) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 18 16:34:02.173558 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-d3034a06-408d-4314-ab89-3dfc608e5e9e tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.100014 Jan 18 16:34:02.177804 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 301/615] 10.222.0.82 () {60 vars in 1146 bytes} [Tue Jan 18 16:34:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1112 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 18 16:34:02.187808 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-2ea0eeb2-ce69-4a00-84d1-4e103285df5f tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:02.188330 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-2ea0eeb2-ce69-4a00-84d1-4e103285df5f tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] [instance: 17780bc8-43cc-4572-81bc-e15bfcc81035] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:02.317193 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-2ea0eeb2-ce69-4a00-84d1-4e103285df5f tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbc235b02424200b625af5b9995bbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417f505277c847cf9b6aaf89f1639bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:02.332942 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-2ea0eeb2-ce69-4a00-84d1-4e103285df5f tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] 10.222.0.82 "GET /compute/v2.1/servers/17780bc8-43cc-4572-81bc-e15bfcc81035" status: 200 len: 1219 microversion: 2.1 time: 0.148961 Jan 18 16:34:02.334522 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 315/616] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:34:02 2022] GET /compute/v2.1/servers/17780bc8-43cc-4572-81bc-e15bfcc81035 => generated 1219 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:34:02.416544 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-623c3dd1-0fc4-46a2-b17d-08f7fe01fb18 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:02.421873 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-623c3dd1-0fc4-46a2-b17d-08f7fe01fb18 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] [instance: d5f46b70-ff39-46b9-912c-206b0683ed70] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:02.436133 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-623c3dd1-0fc4-46a2-b17d-08f7fe01fb18 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:02.439874 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-623c3dd1-0fc4-46a2-b17d-08f7fe01fb18 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:02.448988 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-623c3dd1-0fc4-46a2-b17d-08f7fe01fb18 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:02.450029 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-623c3dd1-0fc4-46a2-b17d-08f7fe01fb18 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:02.719616 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-623c3dd1-0fc4-46a2-b17d-08f7fe01fb18 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2d1245fe3f4bf596e1c0f6978e34bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b7bab53ef4d6e869362551b3cfb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:02.733319 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-623c3dd1-0fc4-46a2-b17d-08f7fe01fb18 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] 10.222.0.82 "GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70" status: 200 len: 1271 microversion: 2.1 time: 0.321287 Jan 18 16:34:02.738935 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 302/617] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:34:02 2022] GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70 => generated 1271 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:34:02.782761 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-2748b595-ae78-401d-8917-860c2efd5ca1 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:02.783386 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-2748b595-ae78-401d-8917-860c2efd5ca1 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:02.792479 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2748b595-ae78-401d-8917-860c2efd5ca1 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:02.793213 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2748b595-ae78-401d-8917-860c2efd5ca1 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:02.794534 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2748b595-ae78-401d-8917-860c2efd5ca1 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:02.795069 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2748b595-ae78-401d-8917-860c2efd5ca1 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:02.982373 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-2748b595-ae78-401d-8917-860c2efd5ca1 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0509d42df8844400b99d7c060ab98c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:02.995400 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-2748b595-ae78-401d-8917-860c2efd5ca1 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 200 len: 1594 microversion: 2.1 time: 0.216207 Jan 18 16:34:02.996524 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 316/618] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:34:02 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 1594 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:34:03.269932 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [req-dd2fa2de-ea82-4d25-92ad-b8b44dfb86de req-6ef0fa35-9dd9-4f79-886d-c4c34e5c298c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5f46b70-ff39-46b9-912c-206b0683ed70", "tag": "66167132-c1b5-4c9b-983f-cc21fd90ca2e"}]} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:34:03.271820 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:34:03.271820 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: warnings.warn(msg) Jan 18 16:34:03.279989 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-dd2fa2de-ea82-4d25-92ad-b8b44dfb86de req-6ef0fa35-9dd9-4f79-886d-c4c34e5c298c service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:03.280435 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-dd2fa2de-ea82-4d25-92ad-b8b44dfb86de req-6ef0fa35-9dd9-4f79-886d-c4c34e5c298c service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:03.305448 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.compute.server_external_events [req-dd2fa2de-ea82-4d25-92ad-b8b44dfb86de req-6ef0fa35-9dd9-4f79-886d-c4c34e5c298c service nova] Creating event network-changed:66167132-c1b5-4c9b-983f-cc21fd90ca2e for instance d5f46b70-ff39-46b9-912c-206b0683ed70 on hv-cinder-78836 Jan 18 16:34:03.311057 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [req-dd2fa2de-ea82-4d25-92ad-b8b44dfb86de req-6ef0fa35-9dd9-4f79-886d-c4c34e5c298c service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047701 Jan 18 16:34:03.312400 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 303/619] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:34:03.351570 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-25653c9e-9ae2-4aa1-9967-3d666410929d tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:03.352183 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-25653c9e-9ae2-4aa1-9967-3d666410929d tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] [instance: 17780bc8-43cc-4572-81bc-e15bfcc81035] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:03.363255 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-25653c9e-9ae2-4aa1-9967-3d666410929d tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:03.363725 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-25653c9e-9ae2-4aa1-9967-3d666410929d tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:03.364639 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-25653c9e-9ae2-4aa1-9967-3d666410929d tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:03.365151 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-25653c9e-9ae2-4aa1-9967-3d666410929d tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:03.512572 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-25653c9e-9ae2-4aa1-9967-3d666410929d tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbc235b02424200b625af5b9995bbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417f505277c847cf9b6aaf89f1639bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:03.525671 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-25653c9e-9ae2-4aa1-9967-3d666410929d tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] 10.222.0.82 "GET /compute/v2.1/servers/17780bc8-43cc-4572-81bc-e15bfcc81035" status: 200 len: 1223 microversion: 2.1 time: 0.176643 Jan 18 16:34:03.526604 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 317/620] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:34:03 2022] GET /compute/v2.1/servers/17780bc8-43cc-4572-81bc-e15bfcc81035 => generated 1223 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:34:03.755925 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-bbb98b51-e866-401b-b2f5-2b450e4a3ea9 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:03.756746 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-bbb98b51-e866-401b-b2f5-2b450e4a3ea9 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] [instance: d5f46b70-ff39-46b9-912c-206b0683ed70] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:03.767031 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-bbb98b51-e866-401b-b2f5-2b450e4a3ea9 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:03.767659 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-bbb98b51-e866-401b-b2f5-2b450e4a3ea9 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:03.769539 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-bbb98b51-e866-401b-b2f5-2b450e4a3ea9 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:03.770058 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-bbb98b51-e866-401b-b2f5-2b450e4a3ea9 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:03.999399 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-bbb98b51-e866-401b-b2f5-2b450e4a3ea9 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2d1245fe3f4bf596e1c0f6978e34bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b7bab53ef4d6e869362551b3cfb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:04.008999 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-bbb98b51-e866-401b-b2f5-2b450e4a3ea9 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] 10.222.0.82 "GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70" status: 200 len: 1259 microversion: 2.1 time: 0.258535 Jan 18 16:34:04.021016 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 304/621] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:34:03 2022] GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70 => generated 1259 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:34:04.544021 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-a7f2caf1-d249-467c-a54e-6da0915203a2 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:04.544729 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-a7f2caf1-d249-467c-a54e-6da0915203a2 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] [instance: 17780bc8-43cc-4572-81bc-e15bfcc81035] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:04.550816 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a7f2caf1-d249-467c-a54e-6da0915203a2 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:04.551267 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a7f2caf1-d249-467c-a54e-6da0915203a2 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:04.552051 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a7f2caf1-d249-467c-a54e-6da0915203a2 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:04.552455 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a7f2caf1-d249-467c-a54e-6da0915203a2 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:04.897967 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-a7f2caf1-d249-467c-a54e-6da0915203a2 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbc235b02424200b625af5b9995bbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417f505277c847cf9b6aaf89f1639bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:04.905013 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-a7f2caf1-d249-467c-a54e-6da0915203a2 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] 10.222.0.82 "GET /compute/v2.1/servers/17780bc8-43cc-4572-81bc-e15bfcc81035" status: 200 len: 1223 microversion: 2.1 time: 0.364742 Jan 18 16:34:04.905786 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 318/622] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:34:04 2022] GET /compute/v2.1/servers/17780bc8-43cc-4572-81bc-e15bfcc81035 => generated 1223 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:34:05.030270 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-24e29e01-5d38-4501-afa0-cae89caa495d tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:05.030865 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-24e29e01-5d38-4501-afa0-cae89caa495d tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] [instance: d5f46b70-ff39-46b9-912c-206b0683ed70] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:05.037341 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-24e29e01-5d38-4501-afa0-cae89caa495d tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:05.037788 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-24e29e01-5d38-4501-afa0-cae89caa495d tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:05.038563 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-24e29e01-5d38-4501-afa0-cae89caa495d tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:05.038994 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-24e29e01-5d38-4501-afa0-cae89caa495d tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:05.291330 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-24e29e01-5d38-4501-afa0-cae89caa495d tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2d1245fe3f4bf596e1c0f6978e34bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b7bab53ef4d6e869362551b3cfb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:05.298634 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-24e29e01-5d38-4501-afa0-cae89caa495d tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] 10.222.0.82 "GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70" status: 200 len: 1259 microversion: 2.1 time: 0.272045 Jan 18 16:34:05.299539 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 305/623] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:34:05 2022] GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70 => generated 1259 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:34:05.744362 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [req-9a125065-b4fd-48ca-ae72-08d8eec940b3 req-027fda62-595f-4f8f-bde3-1a89a536c6cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "218c4c12-4e16-4dc9-8519-bcef764f01c6", "tag": "684a69e2-8aee-429a-ad20-cba1e94ddb16"}]} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:34:05.747342 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:34:05.747342 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: warnings.warn(msg) Jan 18 16:34:05.759522 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-9a125065-b4fd-48ca-ae72-08d8eec940b3 req-027fda62-595f-4f8f-bde3-1a89a536c6cd service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:05.764443 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-9a125065-b4fd-48ca-ae72-08d8eec940b3 req-027fda62-595f-4f8f-bde3-1a89a536c6cd service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:05.783253 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.compute.server_external_events [req-9a125065-b4fd-48ca-ae72-08d8eec940b3 req-027fda62-595f-4f8f-bde3-1a89a536c6cd service nova] Creating event network-changed:684a69e2-8aee-429a-ad20-cba1e94ddb16 for instance 218c4c12-4e16-4dc9-8519-bcef764f01c6 on hv-cinder-78836 Jan 18 16:34:05.789955 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [req-9a125065-b4fd-48ca-ae72-08d8eec940b3 req-027fda62-595f-4f8f-bde3-1a89a536c6cd service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050014 Jan 18 16:34:05.791340 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 319/624] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:34:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:34:05.925159 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-c8d02761-53b0-4111-94ee-e896bfcd804e tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:05.926505 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-c8d02761-53b0-4111-94ee-e896bfcd804e tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] [instance: 17780bc8-43cc-4572-81bc-e15bfcc81035] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:05.940301 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c8d02761-53b0-4111-94ee-e896bfcd804e tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:05.941106 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c8d02761-53b0-4111-94ee-e896bfcd804e tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:05.941973 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c8d02761-53b0-4111-94ee-e896bfcd804e tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:05.942771 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c8d02761-53b0-4111-94ee-e896bfcd804e tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:06.084572 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-c8d02761-53b0-4111-94ee-e896bfcd804e tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbc235b02424200b625af5b9995bbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417f505277c847cf9b6aaf89f1639bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:06.097286 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-c8d02761-53b0-4111-94ee-e896bfcd804e tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] 10.222.0.82 "GET /compute/v2.1/servers/17780bc8-43cc-4572-81bc-e15bfcc81035" status: 200 len: 1271 microversion: 2.1 time: 0.176529 Jan 18 16:34:06.098893 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 306/625] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:34:05 2022] GET /compute/v2.1/servers/17780bc8-43cc-4572-81bc-e15bfcc81035 => generated 1271 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:34:06.317389 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-986163a4-f880-4fbb-a62d-467bd2b3ac66 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:06.318319 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-986163a4-f880-4fbb-a62d-467bd2b3ac66 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] [instance: d5f46b70-ff39-46b9-912c-206b0683ed70] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:06.325414 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-986163a4-f880-4fbb-a62d-467bd2b3ac66 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:06.326066 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-986163a4-f880-4fbb-a62d-467bd2b3ac66 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:06.328942 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-986163a4-f880-4fbb-a62d-467bd2b3ac66 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:06.329668 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-986163a4-f880-4fbb-a62d-467bd2b3ac66 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:06.769348 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-986163a4-f880-4fbb-a62d-467bd2b3ac66 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2d1245fe3f4bf596e1c0f6978e34bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b7bab53ef4d6e869362551b3cfb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:06.778967 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-986163a4-f880-4fbb-a62d-467bd2b3ac66 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] 10.222.0.82 "GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70" status: 200 len: 1259 microversion: 2.1 time: 0.467031 Jan 18 16:34:06.782358 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 320/626] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:34:06 2022] GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70 => generated 1259 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:34:07.117168 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-f9deab97-345f-4df5-8966-6244da167dca tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:07.117850 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-f9deab97-345f-4df5-8966-6244da167dca tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] [instance: 17780bc8-43cc-4572-81bc-e15bfcc81035] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:07.130768 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f9deab97-345f-4df5-8966-6244da167dca tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:07.132253 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f9deab97-345f-4df5-8966-6244da167dca tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:07.133112 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f9deab97-345f-4df5-8966-6244da167dca tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:07.133558 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f9deab97-345f-4df5-8966-6244da167dca tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:07.287732 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-f9deab97-345f-4df5-8966-6244da167dca tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbc235b02424200b625af5b9995bbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417f505277c847cf9b6aaf89f1639bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:07.305286 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-f9deab97-345f-4df5-8966-6244da167dca tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] 10.222.0.82 "GET /compute/v2.1/servers/17780bc8-43cc-4572-81bc-e15bfcc81035" status: 200 len: 1277 microversion: 2.1 time: 0.192961 Jan 18 16:34:07.317083 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 307/627] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:34:07 2022] GET /compute/v2.1/servers/17780bc8-43cc-4572-81bc-e15bfcc81035 => generated 1277 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:34:07.800914 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-ee3f5501-096f-4b21-926f-7fdf1911fdbe tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:07.802485 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-ee3f5501-096f-4b21-926f-7fdf1911fdbe tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] [instance: d5f46b70-ff39-46b9-912c-206b0683ed70] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:07.809491 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-ee3f5501-096f-4b21-926f-7fdf1911fdbe tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:07.810385 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-ee3f5501-096f-4b21-926f-7fdf1911fdbe tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:07.811369 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-ee3f5501-096f-4b21-926f-7fdf1911fdbe tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:07.811792 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-ee3f5501-096f-4b21-926f-7fdf1911fdbe tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:07.986732 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-c83463c9-eea7-4baa-87bd-c194e42d988f tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1570491636"}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:34:07.987610 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-c83463c9-eea7-4baa-87bd-c194e42d988f tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:07.994018 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c83463c9-eea7-4baa-87bd-c194e42d988f tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:07.994565 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c83463c9-eea7-4baa-87bd-c194e42d988f tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:07.995426 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c83463c9-eea7-4baa-87bd-c194e42d988f tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:07.995935 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c83463c9-eea7-4baa-87bd-c194e42d988f tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:08.042431 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-ee3f5501-096f-4b21-926f-7fdf1911fdbe tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2d1245fe3f4bf596e1c0f6978e34bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b7bab53ef4d6e869362551b3cfb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:08.050045 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-ee3f5501-096f-4b21-926f-7fdf1911fdbe tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] 10.222.0.82 "GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70" status: 200 len: 1259 microversion: 2.1 time: 0.254269 Jan 18 16:34:08.050615 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 321/628] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:34:07 2022] GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70 => generated 1259 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:34:08.250440 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.network.security_group_api [None req-c83463c9-eea7-4baa-87bd-c194e42d988f tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Adding security group f9dc9be4-c094-4811-bf84-edfcc03687aa to port 684a69e2-8aee-429a-ad20-cba1e94ddb16 Jan 18 16:34:08.322958 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-aaa799bb-e3eb-4ac9-b115-3dd0a4d878d4 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:08.323673 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-aaa799bb-e3eb-4ac9-b115-3dd0a4d878d4 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] [instance: 17780bc8-43cc-4572-81bc-e15bfcc81035] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:08.329575 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-aaa799bb-e3eb-4ac9-b115-3dd0a4d878d4 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:08.330028 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-aaa799bb-e3eb-4ac9-b115-3dd0a4d878d4 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:08.331666 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-aaa799bb-e3eb-4ac9-b115-3dd0a4d878d4 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:08.332100 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-aaa799bb-e3eb-4ac9-b115-3dd0a4d878d4 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:08.738788 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-aaa799bb-e3eb-4ac9-b115-3dd0a4d878d4 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbc235b02424200b625af5b9995bbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417f505277c847cf9b6aaf89f1639bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:08.747818 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-aaa799bb-e3eb-4ac9-b115-3dd0a4d878d4 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] 10.222.0.82 "GET /compute/v2.1/servers/17780bc8-43cc-4572-81bc-e15bfcc81035" status: 200 len: 1319 microversion: 2.1 time: 0.428225 Jan 18 16:34:08.757834 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 322/629] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:34:08 2022] GET /compute/v2.1/servers/17780bc8-43cc-4572-81bc-e15bfcc81035 => generated 1319 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:34:08.956280 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-c83463c9-eea7-4baa-87bd-c194e42d988f tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "POST /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6/action" status: 202 len: 0 microversion: 2.1 time: 0.972827 Jan 18 16:34:08.959422 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 308/630] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:34:07 2022] POST /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6/action => generated 0 bytes in 978 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:34:08.971538 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-65fabf1d-94f6-48d4-835f-eca353ace133 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:08.972310 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-65fabf1d-94f6-48d4-835f-eca353ace133 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:08.980478 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [req-f3c8d809-4f2a-487a-8be8-59859b981e95 req-7e9aaf56-e611-4866-9310-d5311249d9ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "218c4c12-4e16-4dc9-8519-bcef764f01c6", "tag": "684a69e2-8aee-429a-ad20-cba1e94ddb16"}]} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:34:08.989204 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:34:08.989204 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: warnings.warn(msg) Jan 18 16:34:08.995586 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-65fabf1d-94f6-48d4-835f-eca353ace133 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:08.995774 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-65fabf1d-94f6-48d4-835f-eca353ace133 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:09.004106 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-65fabf1d-94f6-48d4-835f-eca353ace133 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:09.004590 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-65fabf1d-94f6-48d4-835f-eca353ace133 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:09.006468 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-f3c8d809-4f2a-487a-8be8-59859b981e95 req-7e9aaf56-e611-4866-9310-d5311249d9ec service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:09.006932 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-f3c8d809-4f2a-487a-8be8-59859b981e95 req-7e9aaf56-e611-4866-9310-d5311249d9ec service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:09.035689 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.compute.server_external_events [req-f3c8d809-4f2a-487a-8be8-59859b981e95 req-7e9aaf56-e611-4866-9310-d5311249d9ec service nova] Creating event network-changed:684a69e2-8aee-429a-ad20-cba1e94ddb16 for instance 218c4c12-4e16-4dc9-8519-bcef764f01c6 on hv-cinder-78836 Jan 18 16:34:09.049444 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [req-f3c8d809-4f2a-487a-8be8-59859b981e95 req-7e9aaf56-e611-4866-9310-d5311249d9ec service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076418 Jan 18 16:34:09.050912 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 309/631] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:34:09.084209 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-8a54a635-ae9e-436f-a76c-f1ba55a4a121 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:09.089396 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-8a54a635-ae9e-436f-a76c-f1ba55a4a121 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] [instance: d5f46b70-ff39-46b9-912c-206b0683ed70] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:09.104336 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8a54a635-ae9e-436f-a76c-f1ba55a4a121 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:09.107570 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8a54a635-ae9e-436f-a76c-f1ba55a4a121 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:09.114370 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8a54a635-ae9e-436f-a76c-f1ba55a4a121 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:09.115296 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8a54a635-ae9e-436f-a76c-f1ba55a4a121 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:09.876431 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-65fabf1d-94f6-48d4-835f-eca353ace133 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0509d42df8844400b99d7c060ab98c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:09.890823 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-65fabf1d-94f6-48d4-835f-eca353ace133 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 200 len: 1760 microversion: 2.1 time: 0.925151 Jan 18 16:34:09.896422 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-8a54a635-ae9e-436f-a76c-f1ba55a4a121 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2d1245fe3f4bf596e1c0f6978e34bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b7bab53ef4d6e869362551b3cfb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:09.904590 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-8a54a635-ae9e-436f-a76c-f1ba55a4a121 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] 10.222.0.82 "GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70" status: 200 len: 1259 microversion: 2.1 time: 0.841234 Jan 18 16:34:09.914995 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 310/632] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:34:09 2022] GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70 => generated 1259 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:34:09.919739 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-2dc11153-0597-4b8b-b0f4-d240de1b650e tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:09.920526 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 323/633] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:34:08 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 1760 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:34:09.920770 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-2dc11153-0597-4b8b-b0f4-d240de1b650e tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] [instance: 17780bc8-43cc-4572-81bc-e15bfcc81035] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:09.927941 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-2dc11153-0597-4b8b-b0f4-d240de1b650e tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:09.929111 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-2dc11153-0597-4b8b-b0f4-d240de1b650e tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:09.930139 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-2dc11153-0597-4b8b-b0f4-d240de1b650e tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:09.930732 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-2dc11153-0597-4b8b-b0f4-d240de1b650e tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:10.153075 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-2dc11153-0597-4b8b-b0f4-d240de1b650e tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbc235b02424200b625af5b9995bbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417f505277c847cf9b6aaf89f1639bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:10.161249 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-2dc11153-0597-4b8b-b0f4-d240de1b650e tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] 10.222.0.82 "GET /compute/v2.1/servers/17780bc8-43cc-4572-81bc-e15bfcc81035" status: 200 len: 1319 microversion: 2.1 time: 0.244922 Jan 18 16:34:10.165282 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 311/634] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:34:09 2022] GET /compute/v2.1/servers/17780bc8-43cc-4572-81bc-e15bfcc81035 => generated 1319 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:34:10.921820 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-c12327aa-273c-4ffe-9728-c6c7fe1ba150 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:10.922413 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-c12327aa-273c-4ffe-9728-c6c7fe1ba150 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] [instance: d5f46b70-ff39-46b9-912c-206b0683ed70] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:10.928506 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c12327aa-273c-4ffe-9728-c6c7fe1ba150 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:10.928980 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c12327aa-273c-4ffe-9728-c6c7fe1ba150 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:10.929746 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c12327aa-273c-4ffe-9728-c6c7fe1ba150 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:10.930169 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c12327aa-273c-4ffe-9728-c6c7fe1ba150 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:11.083123 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [req-4a90c1e7-2936-43f0-8302-4e069270c35d req-63f55e2a-6408-46c0-8874-1db25158b765 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17780bc8-43cc-4572-81bc-e15bfcc81035", "tag": "65cfe349-cadd-40c9-ad65-9692bccf08bc"}]} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:34:11.085885 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:34:11.085885 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: warnings.warn(msg) Jan 18 16:34:11.094250 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-4a90c1e7-2936-43f0-8302-4e069270c35d req-63f55e2a-6408-46c0-8874-1db25158b765 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:11.094876 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-4a90c1e7-2936-43f0-8302-4e069270c35d req-63f55e2a-6408-46c0-8874-1db25158b765 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:11.096096 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-c12327aa-273c-4ffe-9728-c6c7fe1ba150 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2d1245fe3f4bf596e1c0f6978e34bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b7bab53ef4d6e869362551b3cfb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:11.103499 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-c12327aa-273c-4ffe-9728-c6c7fe1ba150 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] 10.222.0.82 "GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70" status: 200 len: 1259 microversion: 2.1 time: 0.185314 Jan 18 16:34:11.104530 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 324/635] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:34:10 2022] GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70 => generated 1259 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:34:11.116460 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.compute.server_external_events [req-4a90c1e7-2936-43f0-8302-4e069270c35d req-63f55e2a-6408-46c0-8874-1db25158b765 service nova] Creating event network-changed:65cfe349-cadd-40c9-ad65-9692bccf08bc for instance 17780bc8-43cc-4572-81bc-e15bfcc81035 on hv-cinder-78836 Jan 18 16:34:11.121336 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [req-4a90c1e7-2936-43f0-8302-4e069270c35d req-63f55e2a-6408-46c0-8874-1db25158b765 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042853 Jan 18 16:34:11.121934 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 312/636] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:34:11.178161 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-a205b554-908a-44c6-9289-26389123ecdd tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:11.178955 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-a205b554-908a-44c6-9289-26389123ecdd tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] [instance: 17780bc8-43cc-4572-81bc-e15bfcc81035] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:11.184746 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a205b554-908a-44c6-9289-26389123ecdd tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:11.185314 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a205b554-908a-44c6-9289-26389123ecdd tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:11.186150 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a205b554-908a-44c6-9289-26389123ecdd tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:11.186572 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a205b554-908a-44c6-9289-26389123ecdd tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:11.473065 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-a205b554-908a-44c6-9289-26389123ecdd tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbc235b02424200b625af5b9995bbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417f505277c847cf9b6aaf89f1639bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:11.490917 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-a205b554-908a-44c6-9289-26389123ecdd tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] 10.222.0.82 "GET /compute/v2.1/servers/17780bc8-43cc-4572-81bc-e15bfcc81035" status: 200 len: 1319 microversion: 2.1 time: 0.316389 Jan 18 16:34:11.508694 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 325/637] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:34:11 2022] GET /compute/v2.1/servers/17780bc8-43cc-4572-81bc-e15bfcc81035 => generated 1319 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:34:12.121807 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-37697dd3-b742-498a-8abf-5560d990062a tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:12.122525 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-37697dd3-b742-498a-8abf-5560d990062a tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] [instance: d5f46b70-ff39-46b9-912c-206b0683ed70] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:12.128886 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-37697dd3-b742-498a-8abf-5560d990062a tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:12.129358 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-37697dd3-b742-498a-8abf-5560d990062a tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:12.130140 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-37697dd3-b742-498a-8abf-5560d990062a tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:12.130573 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-37697dd3-b742-498a-8abf-5560d990062a tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:12.270944 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-37697dd3-b742-498a-8abf-5560d990062a tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2d1245fe3f4bf596e1c0f6978e34bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b7bab53ef4d6e869362551b3cfb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:12.279261 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-37697dd3-b742-498a-8abf-5560d990062a tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] 10.222.0.82 "GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70" status: 200 len: 1259 microversion: 2.1 time: 0.161830 Jan 18 16:34:12.279857 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 313/638] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:34:12 2022] GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:34:12.517303 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-d69f1453-6ed8-48a4-9209-3d1b9cb0906d tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:12.518556 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-d69f1453-6ed8-48a4-9209-3d1b9cb0906d tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] [instance: 17780bc8-43cc-4572-81bc-e15bfcc81035] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:12.525217 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-d69f1453-6ed8-48a4-9209-3d1b9cb0906d tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:12.525668 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-d69f1453-6ed8-48a4-9209-3d1b9cb0906d tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:12.526459 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-d69f1453-6ed8-48a4-9209-3d1b9cb0906d tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:12.526896 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-d69f1453-6ed8-48a4-9209-3d1b9cb0906d tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:12.667508 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-d69f1453-6ed8-48a4-9209-3d1b9cb0906d tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbc235b02424200b625af5b9995bbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417f505277c847cf9b6aaf89f1639bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:12.675368 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-d69f1453-6ed8-48a4-9209-3d1b9cb0906d tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] 10.222.0.82 "GET /compute/v2.1/servers/17780bc8-43cc-4572-81bc-e15bfcc81035" status: 200 len: 1319 microversion: 2.1 time: 0.162435 Jan 18 16:34:12.676007 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 326/639] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:34:12 2022] GET /compute/v2.1/servers/17780bc8-43cc-4572-81bc-e15bfcc81035 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:34:13.298501 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-11b73c33-3296-4aaf-80aa-0af9fd2bef69 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:13.299784 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-11b73c33-3296-4aaf-80aa-0af9fd2bef69 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] [instance: d5f46b70-ff39-46b9-912c-206b0683ed70] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:13.306120 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-11b73c33-3296-4aaf-80aa-0af9fd2bef69 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:13.306577 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-11b73c33-3296-4aaf-80aa-0af9fd2bef69 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:13.307379 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-11b73c33-3296-4aaf-80aa-0af9fd2bef69 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:13.307799 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-11b73c33-3296-4aaf-80aa-0af9fd2bef69 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:13.442929 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-11b73c33-3296-4aaf-80aa-0af9fd2bef69 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2d1245fe3f4bf596e1c0f6978e34bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b7bab53ef4d6e869362551b3cfb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:13.450154 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-11b73c33-3296-4aaf-80aa-0af9fd2bef69 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] 10.222.0.82 "GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70" status: 200 len: 1259 microversion: 2.1 time: 0.157109 Jan 18 16:34:13.450716 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 314/640] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:34:13 2022] GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:34:13.692470 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-dd3fb337-bc1b-4219-be02-b43cfd7f63a5 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:13.693167 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-dd3fb337-bc1b-4219-be02-b43cfd7f63a5 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] [instance: 17780bc8-43cc-4572-81bc-e15bfcc81035] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:13.699712 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-dd3fb337-bc1b-4219-be02-b43cfd7f63a5 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:13.700227 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-dd3fb337-bc1b-4219-be02-b43cfd7f63a5 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:13.701115 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-dd3fb337-bc1b-4219-be02-b43cfd7f63a5 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:13.701631 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-dd3fb337-bc1b-4219-be02-b43cfd7f63a5 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:13.837626 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-dd3fb337-bc1b-4219-be02-b43cfd7f63a5 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbc235b02424200b625af5b9995bbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417f505277c847cf9b6aaf89f1639bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:13.844754 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-dd3fb337-bc1b-4219-be02-b43cfd7f63a5 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] 10.222.0.82 "GET /compute/v2.1/servers/17780bc8-43cc-4572-81bc-e15bfcc81035" status: 200 len: 1319 microversion: 2.1 time: 0.157038 Jan 18 16:34:13.845385 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 327/641] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:34:13 2022] GET /compute/v2.1/servers/17780bc8-43cc-4572-81bc-e15bfcc81035 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:34:14.467209 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-90fb5e07-cca0-4639-8caf-2051df4fac47 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:14.467838 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-90fb5e07-cca0-4639-8caf-2051df4fac47 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] [instance: d5f46b70-ff39-46b9-912c-206b0683ed70] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:14.474563 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-90fb5e07-cca0-4639-8caf-2051df4fac47 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:14.475017 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-90fb5e07-cca0-4639-8caf-2051df4fac47 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:14.475812 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-90fb5e07-cca0-4639-8caf-2051df4fac47 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:14.476250 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-90fb5e07-cca0-4639-8caf-2051df4fac47 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:14.614154 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-90fb5e07-cca0-4639-8caf-2051df4fac47 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2d1245fe3f4bf596e1c0f6978e34bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b7bab53ef4d6e869362551b3cfb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:14.621591 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-90fb5e07-cca0-4639-8caf-2051df4fac47 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] 10.222.0.82 "GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70" status: 200 len: 1259 microversion: 2.1 time: 0.157969 Jan 18 16:34:14.622346 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 315/642] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:34:14 2022] GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:34:14.862451 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-3c9af290-365e-485b-bd2b-812d3b580a9e tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:14.864366 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-3c9af290-365e-485b-bd2b-812d3b580a9e tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] [instance: 17780bc8-43cc-4572-81bc-e15bfcc81035] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:14.870440 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-3c9af290-365e-485b-bd2b-812d3b580a9e tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:14.871282 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-3c9af290-365e-485b-bd2b-812d3b580a9e tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:14.872401 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-3c9af290-365e-485b-bd2b-812d3b580a9e tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:14.873004 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-3c9af290-365e-485b-bd2b-812d3b580a9e tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:15.034207 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-3c9af290-365e-485b-bd2b-812d3b580a9e tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbc235b02424200b625af5b9995bbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417f505277c847cf9b6aaf89f1639bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:15.042182 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-3c9af290-365e-485b-bd2b-812d3b580a9e tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] 10.222.0.82 "GET /compute/v2.1/servers/17780bc8-43cc-4572-81bc-e15bfcc81035" status: 200 len: 1319 microversion: 2.1 time: 0.183822 Jan 18 16:34:15.042737 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 328/643] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:34:14 2022] GET /compute/v2.1/servers/17780bc8-43cc-4572-81bc-e15bfcc81035 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:34:15.639087 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-c6acce53-4e96-4925-bf8f-74465572b130 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:15.639616 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-c6acce53-4e96-4925-bf8f-74465572b130 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] [instance: d5f46b70-ff39-46b9-912c-206b0683ed70] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:15.646516 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c6acce53-4e96-4925-bf8f-74465572b130 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:15.646968 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c6acce53-4e96-4925-bf8f-74465572b130 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:15.647754 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c6acce53-4e96-4925-bf8f-74465572b130 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:15.648191 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c6acce53-4e96-4925-bf8f-74465572b130 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:15.792095 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-c6acce53-4e96-4925-bf8f-74465572b130 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2d1245fe3f4bf596e1c0f6978e34bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b7bab53ef4d6e869362551b3cfb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:15.800152 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-c6acce53-4e96-4925-bf8f-74465572b130 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] 10.222.0.82 "GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70" status: 200 len: 1259 microversion: 2.1 time: 0.164812 Jan 18 16:34:15.801543 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 316/644] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:34:15 2022] GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70 => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:34:16.060379 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-df924882-fb17-4d30-880e-fd8a19a04d12 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:16.061020 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-df924882-fb17-4d30-880e-fd8a19a04d12 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] [instance: 17780bc8-43cc-4572-81bc-e15bfcc81035] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:16.068557 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-df924882-fb17-4d30-880e-fd8a19a04d12 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:16.069027 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-df924882-fb17-4d30-880e-fd8a19a04d12 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:16.069800 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-df924882-fb17-4d30-880e-fd8a19a04d12 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:16.070225 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-df924882-fb17-4d30-880e-fd8a19a04d12 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:16.206501 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-df924882-fb17-4d30-880e-fd8a19a04d12 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbc235b02424200b625af5b9995bbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417f505277c847cf9b6aaf89f1639bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:16.214078 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-df924882-fb17-4d30-880e-fd8a19a04d12 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] 10.222.0.82 "GET /compute/v2.1/servers/17780bc8-43cc-4572-81bc-e15bfcc81035" status: 200 len: 1319 microversion: 2.1 time: 0.157672 Jan 18 16:34:16.214650 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 329/645] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:34:16 2022] GET /compute/v2.1/servers/17780bc8-43cc-4572-81bc-e15bfcc81035 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:34:16.818229 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-4adad488-61ee-4b37-ab15-2292df82b590 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:16.819426 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-4adad488-61ee-4b37-ab15-2292df82b590 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] [instance: d5f46b70-ff39-46b9-912c-206b0683ed70] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:16.826313 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4adad488-61ee-4b37-ab15-2292df82b590 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:16.826809 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4adad488-61ee-4b37-ab15-2292df82b590 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:16.827540 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4adad488-61ee-4b37-ab15-2292df82b590 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:16.827969 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4adad488-61ee-4b37-ab15-2292df82b590 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:16.975179 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-4adad488-61ee-4b37-ab15-2292df82b590 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2d1245fe3f4bf596e1c0f6978e34bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b7bab53ef4d6e869362551b3cfb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:16.985521 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-4adad488-61ee-4b37-ab15-2292df82b590 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] 10.222.0.82 "GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70" status: 200 len: 1259 microversion: 2.1 time: 0.171788 Jan 18 16:34:16.986432 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 317/646] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:34:16 2022] GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70 => generated 1259 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:34:17.074001 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [req-248d5319-8df7-403f-a043-8a40d88665b2 req-6253b6d6-cec4-4773-a1ef-56fc5467b431 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17780bc8-43cc-4572-81bc-e15bfcc81035", "name": "network-vif-plugged", "status": "completed", "tag": "65cfe349-cadd-40c9-ad65-9692bccf08bc"}]} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:34:17.076368 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:34:17.076368 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: warnings.warn(msg) Jan 18 16:34:17.084992 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-248d5319-8df7-403f-a043-8a40d88665b2 req-6253b6d6-cec4-4773-a1ef-56fc5467b431 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:17.085426 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-248d5319-8df7-403f-a043-8a40d88665b2 req-6253b6d6-cec4-4773-a1ef-56fc5467b431 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:17.096856 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.compute.server_external_events [req-248d5319-8df7-403f-a043-8a40d88665b2 req-6253b6d6-cec4-4773-a1ef-56fc5467b431 service nova] Creating event network-vif-plugged:65cfe349-cadd-40c9-ad65-9692bccf08bc for instance 17780bc8-43cc-4572-81bc-e15bfcc81035 on hv-cinder-78836 Jan 18 16:34:17.105341 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [req-248d5319-8df7-403f-a043-8a40d88665b2 req-6253b6d6-cec4-4773-a1ef-56fc5467b431 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034820 Jan 18 16:34:17.106531 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 330/647] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:34:17.231377 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-35bf1324-63d8-44aa-a8a1-4057afeffd56 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:17.232266 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-35bf1324-63d8-44aa-a8a1-4057afeffd56 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] [instance: 17780bc8-43cc-4572-81bc-e15bfcc81035] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:17.238698 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-35bf1324-63d8-44aa-a8a1-4057afeffd56 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:17.239151 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-35bf1324-63d8-44aa-a8a1-4057afeffd56 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:17.239951 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-35bf1324-63d8-44aa-a8a1-4057afeffd56 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:17.240589 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-35bf1324-63d8-44aa-a8a1-4057afeffd56 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:17.427003 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-35bf1324-63d8-44aa-a8a1-4057afeffd56 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbc235b02424200b625af5b9995bbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417f505277c847cf9b6aaf89f1639bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:17.434398 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-35bf1324-63d8-44aa-a8a1-4057afeffd56 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] 10.222.0.82 "GET /compute/v2.1/servers/17780bc8-43cc-4572-81bc-e15bfcc81035" status: 200 len: 1319 microversion: 2.1 time: 0.206696 Jan 18 16:34:17.434890 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 318/648] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:34:17 2022] GET /compute/v2.1/servers/17780bc8-43cc-4572-81bc-e15bfcc81035 => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:34:18.004467 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-4cd841b3-ca04-47a5-95dc-01a8a5badba5 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:18.005258 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-4cd841b3-ca04-47a5-95dc-01a8a5badba5 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] [instance: d5f46b70-ff39-46b9-912c-206b0683ed70] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:18.012038 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4cd841b3-ca04-47a5-95dc-01a8a5badba5 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:18.012520 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4cd841b3-ca04-47a5-95dc-01a8a5badba5 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:18.013401 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4cd841b3-ca04-47a5-95dc-01a8a5badba5 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:18.013878 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4cd841b3-ca04-47a5-95dc-01a8a5badba5 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:18.171717 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-4cd841b3-ca04-47a5-95dc-01a8a5badba5 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2d1245fe3f4bf596e1c0f6978e34bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b7bab53ef4d6e869362551b3cfb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:18.178921 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-4cd841b3-ca04-47a5-95dc-01a8a5badba5 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] 10.222.0.82 "GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70" status: 200 len: 1259 microversion: 2.1 time: 0.178958 Jan 18 16:34:18.179482 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 331/649] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:34:17 2022] GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70 => generated 1259 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:34:18.451142 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-72e65367-98eb-4f6d-8170-3510212e52b7 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:18.451731 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-72e65367-98eb-4f6d-8170-3510212e52b7 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] [instance: 17780bc8-43cc-4572-81bc-e15bfcc81035] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:18.458470 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-72e65367-98eb-4f6d-8170-3510212e52b7 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:18.458909 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-72e65367-98eb-4f6d-8170-3510212e52b7 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:18.459678 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-72e65367-98eb-4f6d-8170-3510212e52b7 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:18.460106 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-72e65367-98eb-4f6d-8170-3510212e52b7 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:18.594730 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-72e65367-98eb-4f6d-8170-3510212e52b7 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbc235b02424200b625af5b9995bbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417f505277c847cf9b6aaf89f1639bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:18.602244 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-72e65367-98eb-4f6d-8170-3510212e52b7 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] 10.222.0.82 "GET /compute/v2.1/servers/17780bc8-43cc-4572-81bc-e15bfcc81035" status: 200 len: 1319 microversion: 2.1 time: 0.154680 Jan 18 16:34:18.602863 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 319/650] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:34:18 2022] GET /compute/v2.1/servers/17780bc8-43cc-4572-81bc-e15bfcc81035 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:34:19.135114 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [req-0f0db7c1-b0a9-4cde-9f84-2ffb886dd0c4 req-66d5a6c5-ae28-4ff6-aca7-90e1ffd70836 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5f46b70-ff39-46b9-912c-206b0683ed70", "name": "network-vif-plugged", "status": "completed", "tag": "66167132-c1b5-4c9b-983f-cc21fd90ca2e"}]} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:34:19.136662 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:34:19.136662 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: warnings.warn(msg) Jan 18 16:34:19.143859 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-0f0db7c1-b0a9-4cde-9f84-2ffb886dd0c4 req-66d5a6c5-ae28-4ff6-aca7-90e1ffd70836 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:19.144843 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-0f0db7c1-b0a9-4cde-9f84-2ffb886dd0c4 req-66d5a6c5-ae28-4ff6-aca7-90e1ffd70836 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:19.156137 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.compute.server_external_events [req-0f0db7c1-b0a9-4cde-9f84-2ffb886dd0c4 req-66d5a6c5-ae28-4ff6-aca7-90e1ffd70836 service nova] Creating event network-vif-plugged:66167132-c1b5-4c9b-983f-cc21fd90ca2e for instance d5f46b70-ff39-46b9-912c-206b0683ed70 on hv-cinder-78836 Jan 18 16:34:19.161974 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [req-0f0db7c1-b0a9-4cde-9f84-2ffb886dd0c4 req-66d5a6c5-ae28-4ff6-aca7-90e1ffd70836 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030554 Jan 18 16:34:19.162561 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 332/651] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:34:19.196543 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-0f17b77a-7f11-492b-a7a5-9d4647069937 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:19.197179 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-0f17b77a-7f11-492b-a7a5-9d4647069937 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] [instance: d5f46b70-ff39-46b9-912c-206b0683ed70] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:19.202986 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0f17b77a-7f11-492b-a7a5-9d4647069937 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:19.203431 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0f17b77a-7f11-492b-a7a5-9d4647069937 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:19.204203 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0f17b77a-7f11-492b-a7a5-9d4647069937 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:19.204629 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0f17b77a-7f11-492b-a7a5-9d4647069937 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:19.352783 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-0f17b77a-7f11-492b-a7a5-9d4647069937 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2d1245fe3f4bf596e1c0f6978e34bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b7bab53ef4d6e869362551b3cfb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:19.360245 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-0f17b77a-7f11-492b-a7a5-9d4647069937 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] 10.222.0.82 "GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70" status: 200 len: 1259 microversion: 2.1 time: 0.167478 Jan 18 16:34:19.360807 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 320/652] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:34:19 2022] GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70 => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:34:19.621099 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-a99d9e19-7373-4696-9c20-bbe0baa2272e tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:19.621784 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-a99d9e19-7373-4696-9c20-bbe0baa2272e tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] [instance: 17780bc8-43cc-4572-81bc-e15bfcc81035] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:19.627720 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a99d9e19-7373-4696-9c20-bbe0baa2272e tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:19.628152 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a99d9e19-7373-4696-9c20-bbe0baa2272e tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:19.629579 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a99d9e19-7373-4696-9c20-bbe0baa2272e tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:19.630000 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a99d9e19-7373-4696-9c20-bbe0baa2272e tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:19.764178 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-a99d9e19-7373-4696-9c20-bbe0baa2272e tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbc235b02424200b625af5b9995bbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417f505277c847cf9b6aaf89f1639bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:19.772003 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-a99d9e19-7373-4696-9c20-bbe0baa2272e tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] 10.222.0.82 "GET /compute/v2.1/servers/17780bc8-43cc-4572-81bc-e15bfcc81035" status: 200 len: 1507 microversion: 2.1 time: 0.155175 Jan 18 16:34:19.772578 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 333/653] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:34:19 2022] GET /compute/v2.1/servers/17780bc8-43cc-4572-81bc-e15bfcc81035 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:34:19.788031 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-7431512f-11a0-4e00-9dfc-ea0b9f9ccc7d tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b7ffb2a0-a6b8-479a-bd36-80dccf674443", "device": "/dev/sdb"}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:34:19.789147 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-7431512f-11a0-4e00-9dfc-ea0b9f9ccc7d tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] [instance: 17780bc8-43cc-4572-81bc-e15bfcc81035] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:19.795304 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7431512f-11a0-4e00-9dfc-ea0b9f9ccc7d tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:19.795748 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7431512f-11a0-4e00-9dfc-ea0b9f9ccc7d tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:19.796525 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7431512f-11a0-4e00-9dfc-ea0b9f9ccc7d tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:19.796992 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7431512f-11a0-4e00-9dfc-ea0b9f9ccc7d tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:20.054838 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-7431512f-11a0-4e00-9dfc-ea0b9f9ccc7d tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] 10.222.0.82 "POST /compute/v2.1/servers/17780bc8-43cc-4572-81bc-e15bfcc81035/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270250 Jan 18 16:34:20.055467 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 321/654] 10.222.0.82 () {60 vars in 1322 bytes} [Tue Jan 18 16:34:19 2022] POST /compute/v2.1/servers/17780bc8-43cc-4572-81bc-e15bfcc81035/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:34:20.376107 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-75fc57c4-790c-4533-af3c-1c76c61ab49e tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:20.376718 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-75fc57c4-790c-4533-af3c-1c76c61ab49e tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] [instance: d5f46b70-ff39-46b9-912c-206b0683ed70] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:20.383460 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-75fc57c4-790c-4533-af3c-1c76c61ab49e tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:20.383905 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-75fc57c4-790c-4533-af3c-1c76c61ab49e tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:20.384867 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-75fc57c4-790c-4533-af3c-1c76c61ab49e tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:20.385327 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-75fc57c4-790c-4533-af3c-1c76c61ab49e tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:20.517607 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-75fc57c4-790c-4533-af3c-1c76c61ab49e tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2d1245fe3f4bf596e1c0f6978e34bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b7bab53ef4d6e869362551b3cfb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:20.525514 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-75fc57c4-790c-4533-af3c-1c76c61ab49e tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] 10.222.0.82 "GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70" status: 200 len: 1259 microversion: 2.1 time: 0.153364 Jan 18 16:34:20.526081 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 334/655] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:34:20 2022] GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:34:21.542762 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-597d400d-9f31-4ca4-af1f-ff73bca32e05 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:21.543447 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-597d400d-9f31-4ca4-af1f-ff73bca32e05 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] [instance: d5f46b70-ff39-46b9-912c-206b0683ed70] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:21.549615 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-597d400d-9f31-4ca4-af1f-ff73bca32e05 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:21.550051 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-597d400d-9f31-4ca4-af1f-ff73bca32e05 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:21.551393 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-597d400d-9f31-4ca4-af1f-ff73bca32e05 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:21.551999 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-597d400d-9f31-4ca4-af1f-ff73bca32e05 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:21.694764 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-597d400d-9f31-4ca4-af1f-ff73bca32e05 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2d1245fe3f4bf596e1c0f6978e34bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b7bab53ef4d6e869362551b3cfb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:21.702233 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-597d400d-9f31-4ca4-af1f-ff73bca32e05 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] 10.222.0.82 "GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70" status: 200 len: 1443 microversion: 2.1 time: 0.163928 Jan 18 16:34:21.702800 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 322/656] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:34:21 2022] GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70 => generated 1443 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:34:21.718740 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-fd1ca878-f286-4f47-8e1c-adb172ca8dbc tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:21.719371 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-fd1ca878-f286-4f47-8e1c-adb172ca8dbc tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] [instance: d5f46b70-ff39-46b9-912c-206b0683ed70] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:21.726491 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-fd1ca878-f286-4f47-8e1c-adb172ca8dbc tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:21.726938 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-fd1ca878-f286-4f47-8e1c-adb172ca8dbc tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:21.727747 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-fd1ca878-f286-4f47-8e1c-adb172ca8dbc tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:21.728181 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-fd1ca878-f286-4f47-8e1c-adb172ca8dbc tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:21.868448 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-fd1ca878-f286-4f47-8e1c-adb172ca8dbc tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2d1245fe3f4bf596e1c0f6978e34bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b7bab53ef4d6e869362551b3cfb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:21.875671 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-fd1ca878-f286-4f47-8e1c-adb172ca8dbc tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] 10.222.0.82 "GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70" status: 200 len: 1443 microversion: 2.1 time: 0.160527 Jan 18 16:34:21.876238 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 335/657] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:34:21 2022] GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70 => generated 1443 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:34:23.651964 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [req-50395643-6358-43ac-8a70-fe78d756a8d6 req-d7fce59b-56be-4c76-b015-19a96c2dd38a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5f46b70-ff39-46b9-912c-206b0683ed70", "tag": "66167132-c1b5-4c9b-983f-cc21fd90ca2e"}]} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:34:23.654191 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:34:23.654191 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: warnings.warn(msg) Jan 18 16:34:23.662052 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-50395643-6358-43ac-8a70-fe78d756a8d6 req-d7fce59b-56be-4c76-b015-19a96c2dd38a service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:23.662453 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-50395643-6358-43ac-8a70-fe78d756a8d6 req-d7fce59b-56be-4c76-b015-19a96c2dd38a service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:23.688205 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.compute.server_external_events [req-50395643-6358-43ac-8a70-fe78d756a8d6 req-d7fce59b-56be-4c76-b015-19a96c2dd38a service nova] Creating event network-changed:66167132-c1b5-4c9b-983f-cc21fd90ca2e for instance d5f46b70-ff39-46b9-912c-206b0683ed70 on hv-cinder-78836 Jan 18 16:34:23.694981 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [req-50395643-6358-43ac-8a70-fe78d756a8d6 req-d7fce59b-56be-4c76-b015-19a96c2dd38a service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046422 Jan 18 16:34:23.695577 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 323/658] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:34:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:34:41.394829 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-8de4c478-df19-47be-a0e7-049eecc2fce7 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:41.395373 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-8de4c478-df19-47be-a0e7-049eecc2fce7 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] [instance: 17780bc8-43cc-4572-81bc-e15bfcc81035] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:41.401542 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-8de4c478-df19-47be-a0e7-049eecc2fce7 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:41.401995 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-8de4c478-df19-47be-a0e7-049eecc2fce7 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:41.402770 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-8de4c478-df19-47be-a0e7-049eecc2fce7 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:41.403202 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-8de4c478-df19-47be-a0e7-049eecc2fce7 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:41.478327 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.objects.instance [None req-8de4c478-df19-47be-a0e7-049eecc2fce7 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lazy-loading 'services' on Instance uuid 17780bc8-43cc-4572-81bc-e15bfcc81035 {{(pid=116367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 18 16:34:41.587480 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-8de4c478-df19-47be-a0e7-049eecc2fce7 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] 10.222.0.82 "DELETE /compute/v2.1/servers/17780bc8-43cc-4572-81bc-e15bfcc81035/os-volume_attachments/b7ffb2a0-a6b8-479a-bd36-80dccf674443" status: 202 len: 0 microversion: 2.1 time: 0.196106 Jan 18 16:34:41.588068 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 336/659] 10.222.0.82 () {58 vars in 1415 bytes} [Tue Jan 18 16:34:41 2022] DELETE /compute/v2.1/servers/17780bc8-43cc-4572-81bc-e15bfcc81035/os-volume_attachments/b7ffb2a0-a6b8-479a-bd36-80dccf674443 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:34:42.701839 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-946be165-e487-4db6-9b4d-c5ae135449cd tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:42.702446 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-946be165-e487-4db6-9b4d-c5ae135449cd tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] [instance: 17780bc8-43cc-4572-81bc-e15bfcc81035] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:42.708300 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-946be165-e487-4db6-9b4d-c5ae135449cd tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:42.708745 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-946be165-e487-4db6-9b4d-c5ae135449cd tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:42.709560 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-946be165-e487-4db6-9b4d-c5ae135449cd tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:42.709996 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-946be165-e487-4db6-9b4d-c5ae135449cd tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:42.735013 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-946be165-e487-4db6-9b4d-c5ae135449cd tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] [instance: 17780bc8-43cc-4572-81bc-e15bfcc81035] Going to try to terminate instance {{(pid=116368) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 18 16:34:42.816425 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-946be165-e487-4db6-9b4d-c5ae135449cd tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] 10.222.0.82 "DELETE /compute/v2.1/servers/17780bc8-43cc-4572-81bc-e15bfcc81035" status: 204 len: 0 microversion: 2.1 time: 0.118625 Jan 18 16:34:42.820205 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 324/660] 10.222.0.82 () {58 vars in 1238 bytes} [Tue Jan 18 16:34:42 2022] DELETE /compute/v2.1/servers/17780bc8-43cc-4572-81bc-e15bfcc81035 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 18 16:34:42.827743 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-4431e1a2-0ef7-4c05-9e85-fa50ed145629 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:42.828706 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-4431e1a2-0ef7-4c05-9e85-fa50ed145629 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] [instance: 17780bc8-43cc-4572-81bc-e15bfcc81035] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:42.835195 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4431e1a2-0ef7-4c05-9e85-fa50ed145629 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:42.835746 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4431e1a2-0ef7-4c05-9e85-fa50ed145629 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:42.836835 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4431e1a2-0ef7-4c05-9e85-fa50ed145629 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:42.837240 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4431e1a2-0ef7-4c05-9e85-fa50ed145629 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:42.990923 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-4431e1a2-0ef7-4c05-9e85-fa50ed145629 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbc235b02424200b625af5b9995bbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417f505277c847cf9b6aaf89f1639bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:43.000050 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-4431e1a2-0ef7-4c05-9e85-fa50ed145629 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] 10.222.0.82 "GET /compute/v2.1/servers/17780bc8-43cc-4572-81bc-e15bfcc81035" status: 200 len: 1513 microversion: 2.1 time: 0.177549 Jan 18 16:34:43.000650 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 337/661] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:34:42 2022] GET /compute/v2.1/servers/17780bc8-43cc-4572-81bc-e15bfcc81035 => generated 1513 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:34:44.026141 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-d433b5d2-ae69-4539-b6a4-a35acef41ab1 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:44.026821 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-d433b5d2-ae69-4539-b6a4-a35acef41ab1 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] [instance: 17780bc8-43cc-4572-81bc-e15bfcc81035] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:44.033310 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d433b5d2-ae69-4539-b6a4-a35acef41ab1 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:44.033762 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d433b5d2-ae69-4539-b6a4-a35acef41ab1 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:44.034562 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d433b5d2-ae69-4539-b6a4-a35acef41ab1 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:44.034997 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d433b5d2-ae69-4539-b6a4-a35acef41ab1 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:44.178802 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-d433b5d2-ae69-4539-b6a4-a35acef41ab1 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbc235b02424200b625af5b9995bbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417f505277c847cf9b6aaf89f1639bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:44.186916 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-d433b5d2-ae69-4539-b6a4-a35acef41ab1 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] 10.222.0.82 "GET /compute/v2.1/servers/17780bc8-43cc-4572-81bc-e15bfcc81035" status: 200 len: 1513 microversion: 2.1 time: 0.165555 Jan 18 16:34:44.187552 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 325/662] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:34:44 2022] GET /compute/v2.1/servers/17780bc8-43cc-4572-81bc-e15bfcc81035 => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:34:45.205820 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-424e9ca5-6f9c-40e4-94e5-01314a9c5c02 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:45.206420 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-424e9ca5-6f9c-40e4-94e5-01314a9c5c02 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] [instance: 17780bc8-43cc-4572-81bc-e15bfcc81035] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:45.213740 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-424e9ca5-6f9c-40e4-94e5-01314a9c5c02 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:45.214187 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-424e9ca5-6f9c-40e4-94e5-01314a9c5c02 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:45.215047 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-424e9ca5-6f9c-40e4-94e5-01314a9c5c02 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:45.215474 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-424e9ca5-6f9c-40e4-94e5-01314a9c5c02 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:45.216407 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [req-7e1e9d71-fbe3-44ae-ad03-9d256a5d9b9a req-b9d6b726-d4b2-454d-8e8b-20ad11141447 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17780bc8-43cc-4572-81bc-e15bfcc81035", "name": "network-vif-deleted", "tag": "65cfe349-cadd-40c9-ad65-9692bccf08bc"}]} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:34:45.217994 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:34:45.217994 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: warnings.warn(msg) Jan 18 16:34:45.226782 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-7e1e9d71-fbe3-44ae-ad03-9d256a5d9b9a req-b9d6b726-d4b2-454d-8e8b-20ad11141447 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:45.227442 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-7e1e9d71-fbe3-44ae-ad03-9d256a5d9b9a req-b9d6b726-d4b2-454d-8e8b-20ad11141447 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:45.238789 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.compute.server_external_events [req-7e1e9d71-fbe3-44ae-ad03-9d256a5d9b9a req-b9d6b726-d4b2-454d-8e8b-20ad11141447 service nova] Creating event network-vif-deleted:65cfe349-cadd-40c9-ad65-9692bccf08bc for instance 17780bc8-43cc-4572-81bc-e15bfcc81035 on hv-cinder-78836 Jan 18 16:34:45.247951 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [req-7e1e9d71-fbe3-44ae-ad03-9d256a5d9b9a req-b9d6b726-d4b2-454d-8e8b-20ad11141447 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034490 Jan 18 16:34:45.249166 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 326/663] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:34:45.281985 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-424e9ca5-6f9c-40e4-94e5-01314a9c5c02 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbc235b02424200b625af5b9995bbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417f505277c847cf9b6aaf89f1639bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:45.289173 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-424e9ca5-6f9c-40e4-94e5-01314a9c5c02 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] 10.222.0.82 "GET /compute/v2.1/servers/17780bc8-43cc-4572-81bc-e15bfcc81035" status: 200 len: 1471 microversion: 2.1 time: 0.086944 Jan 18 16:34:45.290237 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 338/664] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:34:45 2022] GET /compute/v2.1/servers/17780bc8-43cc-4572-81bc-e15bfcc81035 => generated 1471 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:34:46.307736 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-43cf89da-4ba8-4045-82cb-60c0d56755b6 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:46.308427 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-43cf89da-4ba8-4045-82cb-60c0d56755b6 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] [instance: 17780bc8-43cc-4572-81bc-e15bfcc81035] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:46.315154 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-43cf89da-4ba8-4045-82cb-60c0d56755b6 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:46.315624 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-43cf89da-4ba8-4045-82cb-60c0d56755b6 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:46.316671 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-43cf89da-4ba8-4045-82cb-60c0d56755b6 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:46.317146 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-43cf89da-4ba8-4045-82cb-60c0d56755b6 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:46.332008 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.wsgi [None req-43cf89da-4ba8-4045-82cb-60c0d56755b6 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] HTTP exception thrown: Instance 17780bc8-43cc-4572-81bc-e15bfcc81035 could not be found. Jan 18 16:34:46.332603 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-43cf89da-4ba8-4045-82cb-60c0d56755b6 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] Returning 404 to user: Instance 17780bc8-43cc-4572-81bc-e15bfcc81035 could not be found. {{(pid=116368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 16:34:46.333466 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-43cf89da-4ba8-4045-82cb-60c0d56755b6 tempest-VolumesSnapshotTestJSON-925628276 tempest-VolumesSnapshotTestJSON-925628276-project] 10.222.0.82 "GET /compute/v2.1/servers/17780bc8-43cc-4572-81bc-e15bfcc81035" status: 404 len: 111 microversion: 2.1 time: 0.031124 Jan 18 16:34:46.334047 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 327/665] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:34:46 2022] GET /compute/v2.1/servers/17780bc8-43cc-4572-81bc-e15bfcc81035 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 16:34:47.933986 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-34f99bf8-defa-41e2-aea1-4c80561a7975 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:47.934841 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-34f99bf8-defa-41e2-aea1-4c80561a7975 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:47.941752 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-34f99bf8-defa-41e2-aea1-4c80561a7975 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:47.942223 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-34f99bf8-defa-41e2-aea1-4c80561a7975 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:47.943013 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-34f99bf8-defa-41e2-aea1-4c80561a7975 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:47.943501 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-34f99bf8-defa-41e2-aea1-4c80561a7975 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:47.974837 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-34f99bf8-defa-41e2-aea1-4c80561a7975 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/os-volume_attachments/619e0846-ef6d-41ef-971c-52afd9c21aad" status: 200 len: 194 microversion: 2.20 time: 0.045613 Jan 18 16:34:47.975417 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 339/666] 10.222.0.82 () {60 vars in 1453 bytes} [Tue Jan 18 16:34:47 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/os-volume_attachments/619e0846-ef6d-41ef-971c-52afd9c21aad => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:34:48.040138 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-062e3834-d1d3-46f9-9d8e-968d941aeaa5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:48.040680 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-062e3834-d1d3-46f9-9d8e-968d941aeaa5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:48.047459 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-062e3834-d1d3-46f9-9d8e-968d941aeaa5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:48.047910 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-062e3834-d1d3-46f9-9d8e-968d941aeaa5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:48.048704 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-062e3834-d1d3-46f9-9d8e-968d941aeaa5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:48.049178 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-062e3834-d1d3-46f9-9d8e-968d941aeaa5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:48.146957 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.objects.instance [None req-062e3834-d1d3-46f9-9d8e-968d941aeaa5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lazy-loading 'services' on Instance uuid 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee {{(pid=116368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 18 16:34:48.223748 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-062e3834-d1d3-46f9-9d8e-968d941aeaa5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "DELETE /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/os-volume_attachments/619e0846-ef6d-41ef-971c-52afd9c21aad" status: 202 len: 0 microversion: 2.20 time: 0.187297 Jan 18 16:34:48.224573 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 328/667] 10.222.0.82 () {60 vars in 1456 bytes} [Tue Jan 18 16:34:48 2022] DELETE /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/os-volume_attachments/619e0846-ef6d-41ef-971c-52afd9c21aad => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 18 16:34:48.232961 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-a1cb838b-afe1-4d1e-b8f3-994fcd31ccbe tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:48.234230 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-a1cb838b-afe1-4d1e-b8f3-994fcd31ccbe tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:48.242483 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a1cb838b-afe1-4d1e-b8f3-994fcd31ccbe tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:48.243471 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a1cb838b-afe1-4d1e-b8f3-994fcd31ccbe tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:48.244340 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a1cb838b-afe1-4d1e-b8f3-994fcd31ccbe tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:48.244746 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a1cb838b-afe1-4d1e-b8f3-994fcd31ccbe tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:48.275709 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-a1cb838b-afe1-4d1e-b8f3-994fcd31ccbe tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046460 Jan 18 16:34:48.276272 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 340/668] 10.222.0.82 () {60 vars in 1342 bytes} [Tue Jan 18 16:34:48 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:34:49.288561 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-91b53f2a-b414-4880-9f93-5ecf929f4e75 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:49.289606 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-91b53f2a-b414-4880-9f93-5ecf929f4e75 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:49.298031 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-91b53f2a-b414-4880-9f93-5ecf929f4e75 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:49.298477 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-91b53f2a-b414-4880-9f93-5ecf929f4e75 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:49.299254 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-91b53f2a-b414-4880-9f93-5ecf929f4e75 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:49.299687 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-91b53f2a-b414-4880-9f93-5ecf929f4e75 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:49.329228 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-91b53f2a-b414-4880-9f93-5ecf929f4e75 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045296 Jan 18 16:34:49.329799 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 329/669] 10.222.0.82 () {60 vars in 1342 bytes} [Tue Jan 18 16:34:49 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:34:49.536241 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-21edf7b1-411d-4732-a082-4483bfcfc609 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:34:49.537113 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-21edf7b1-411d-4732-a082-4483bfcfc609 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:49.543413 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-21edf7b1-411d-4732-a082-4483bfcfc609 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:49.543851 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-21edf7b1-411d-4732-a082-4483bfcfc609 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:49.544614 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-21edf7b1-411d-4732-a082-4483bfcfc609 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:49.545078 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-21edf7b1-411d-4732-a082-4483bfcfc609 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:49.618490 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-21edf7b1-411d-4732-a082-4483bfcfc609 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "POST /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6/action" status: 202 len: 0 microversion: 2.1 time: 0.085243 Jan 18 16:34:49.619105 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 341/670] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:34:49 2022] POST /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:34:49.627050 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-9a2c61c8-a50a-481d-a5f3-2cbd917c4929 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:49.627657 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-9a2c61c8-a50a-481d-a5f3-2cbd917c4929 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:49.634238 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-9a2c61c8-a50a-481d-a5f3-2cbd917c4929 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:49.634768 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-9a2c61c8-a50a-481d-a5f3-2cbd917c4929 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:49.635549 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-9a2c61c8-a50a-481d-a5f3-2cbd917c4929 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:49.635987 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-9a2c61c8-a50a-481d-a5f3-2cbd917c4929 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:49.782112 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-9a2c61c8-a50a-481d-a5f3-2cbd917c4929 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0509d42df8844400b99d7c060ab98c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:49.790623 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-9a2c61c8-a50a-481d-a5f3-2cbd917c4929 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 200 len: 1752 microversion: 2.1 time: 0.167093 Jan 18 16:34:49.791134 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 330/671] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:34:49 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 1752 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:34:50.340779 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-a6797319-0405-41a9-8da3-e101007e0a52 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:50.341802 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-a6797319-0405-41a9-8da3-e101007e0a52 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:50.347804 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a6797319-0405-41a9-8da3-e101007e0a52 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:50.348252 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a6797319-0405-41a9-8da3-e101007e0a52 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:50.349058 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a6797319-0405-41a9-8da3-e101007e0a52 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:50.349490 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a6797319-0405-41a9-8da3-e101007e0a52 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:50.378136 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-a6797319-0405-41a9-8da3-e101007e0a52 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041623 Jan 18 16:34:50.378617 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 342/672] 10.222.0.82 () {60 vars in 1342 bytes} [Tue Jan 18 16:34:50 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:34:50.808323 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-cce13048-8ed5-4bc6-92da-c9cebdfe6a36 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:50.808943 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-cce13048-8ed5-4bc6-92da-c9cebdfe6a36 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:50.815265 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-cce13048-8ed5-4bc6-92da-c9cebdfe6a36 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:50.815967 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-cce13048-8ed5-4bc6-92da-c9cebdfe6a36 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:50.816744 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-cce13048-8ed5-4bc6-92da-c9cebdfe6a36 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:50.817214 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-cce13048-8ed5-4bc6-92da-c9cebdfe6a36 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:51.031391 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-cce13048-8ed5-4bc6-92da-c9cebdfe6a36 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0509d42df8844400b99d7c060ab98c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:51.039446 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-cce13048-8ed5-4bc6-92da-c9cebdfe6a36 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 200 len: 1752 microversion: 2.1 time: 0.235291 Jan 18 16:34:51.040881 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 331/673] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:34:50 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 1752 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:34:51.390594 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-b1d89457-c600-428b-ab8f-6c802ac8255f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:51.392246 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-b1d89457-c600-428b-ab8f-6c802ac8255f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:51.400660 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-b1d89457-c600-428b-ab8f-6c802ac8255f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:51.401160 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-b1d89457-c600-428b-ab8f-6c802ac8255f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:51.401947 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-b1d89457-c600-428b-ab8f-6c802ac8255f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:51.402376 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-b1d89457-c600-428b-ab8f-6c802ac8255f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:51.442267 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-b1d89457-c600-428b-ab8f-6c802ac8255f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.055740 Jan 18 16:34:51.442809 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 343/674] 10.222.0.82 () {60 vars in 1342 bytes} [Tue Jan 18 16:34:51 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:34:51.498870 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-a3b7ba24-227d-43db-84b2-7c39abc9aab1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:51.499371 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-a3b7ba24-227d-43db-84b2-7c39abc9aab1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:51.505107 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a3b7ba24-227d-43db-84b2-7c39abc9aab1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:51.505555 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a3b7ba24-227d-43db-84b2-7c39abc9aab1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:51.506379 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a3b7ba24-227d-43db-84b2-7c39abc9aab1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:51.506811 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a3b7ba24-227d-43db-84b2-7c39abc9aab1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:51.532940 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-a3b7ba24-227d-43db-84b2-7c39abc9aab1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Going to try to terminate instance {{(pid=116368) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 18 16:34:51.604499 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-a3b7ba24-227d-43db-84b2-7c39abc9aab1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "DELETE /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 204 len: 0 microversion: 2.20 time: 0.108944 Jan 18 16:34:51.605303 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 332/675] 10.222.0.82 () {60 vars in 1279 bytes} [Tue Jan 18 16:34:51 2022] DELETE /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 18 16:34:51.613782 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-2f3e5012-5f23-44d2-8790-3f2df37f0c3b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:51.614399 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-2f3e5012-5f23-44d2-8790-3f2df37f0c3b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:51.620073 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2f3e5012-5f23-44d2-8790-3f2df37f0c3b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:51.620520 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2f3e5012-5f23-44d2-8790-3f2df37f0c3b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:51.621317 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2f3e5012-5f23-44d2-8790-3f2df37f0c3b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:51.621872 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2f3e5012-5f23-44d2-8790-3f2df37f0c3b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:51.751607 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-2f3e5012-5f23-44d2-8790-3f2df37f0c3b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:51.760124 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-2f3e5012-5f23-44d2-8790-3f2df37f0c3b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:51.761650 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-2f3e5012-5f23-44d2-8790-3f2df37f0c3b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:51.762787 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-2f3e5012-5f23-44d2-8790-3f2df37f0c3b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1724 microversion: 2.20 time: 0.152868 Jan 18 16:34:51.763343 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 344/676] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:34:51 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:34:52.057958 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-c1dda081-3a30-4fcd-ad25-1f5bf6296b69 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:52.058619 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-c1dda081-3a30-4fcd-ad25-1f5bf6296b69 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:52.064805 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c1dda081-3a30-4fcd-ad25-1f5bf6296b69 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:52.065289 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c1dda081-3a30-4fcd-ad25-1f5bf6296b69 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:52.066339 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c1dda081-3a30-4fcd-ad25-1f5bf6296b69 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:52.066788 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c1dda081-3a30-4fcd-ad25-1f5bf6296b69 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:52.361162 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-c1dda081-3a30-4fcd-ad25-1f5bf6296b69 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0509d42df8844400b99d7c060ab98c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:52.369853 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-c1dda081-3a30-4fcd-ad25-1f5bf6296b69 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 200 len: 1757 microversion: 2.1 time: 0.316689 Jan 18 16:34:52.370429 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 333/677] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:34:52 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 1757 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:34:52.780094 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-b5db34b0-76f8-44ab-8c3b-946dda682174 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:52.780725 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-b5db34b0-76f8-44ab-8c3b-946dda682174 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:52.787037 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-b5db34b0-76f8-44ab-8c3b-946dda682174 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:52.787495 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-b5db34b0-76f8-44ab-8c3b-946dda682174 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:52.788268 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-b5db34b0-76f8-44ab-8c3b-946dda682174 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:52.788700 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-b5db34b0-76f8-44ab-8c3b-946dda682174 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:52.970073 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-b5db34b0-76f8-44ab-8c3b-946dda682174 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:52.978375 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-b5db34b0-76f8-44ab-8c3b-946dda682174 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:52.979856 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-b5db34b0-76f8-44ab-8c3b-946dda682174 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:52.981010 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-b5db34b0-76f8-44ab-8c3b-946dda682174 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1724 microversion: 2.20 time: 0.204641 Jan 18 16:34:52.981570 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 345/678] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:34:52 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:34:53.387523 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-ce9f5d54-d62d-4942-8619-2cf7585f8580 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:53.388138 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-ce9f5d54-d62d-4942-8619-2cf7585f8580 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:53.394355 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ce9f5d54-d62d-4942-8619-2cf7585f8580 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:53.394802 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ce9f5d54-d62d-4942-8619-2cf7585f8580 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:53.395579 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ce9f5d54-d62d-4942-8619-2cf7585f8580 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:53.396015 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ce9f5d54-d62d-4942-8619-2cf7585f8580 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:53.544401 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-ce9f5d54-d62d-4942-8619-2cf7585f8580 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0509d42df8844400b99d7c060ab98c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:53.552364 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-ce9f5d54-d62d-4942-8619-2cf7585f8580 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 200 len: 1757 microversion: 2.1 time: 0.168494 Jan 18 16:34:53.553301 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 334/679] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:34:53 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:34:54.000893 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-33a129a3-fd37-48fb-948b-9eb92c38f2fe tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:54.001615 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-33a129a3-fd37-48fb-948b-9eb92c38f2fe tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:54.009351 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-33a129a3-fd37-48fb-948b-9eb92c38f2fe tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:54.009805 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-33a129a3-fd37-48fb-948b-9eb92c38f2fe tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:54.010614 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-33a129a3-fd37-48fb-948b-9eb92c38f2fe tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:54.011048 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-33a129a3-fd37-48fb-948b-9eb92c38f2fe tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:54.396704 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-33a129a3-fd37-48fb-948b-9eb92c38f2fe tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:54.404442 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-33a129a3-fd37-48fb-948b-9eb92c38f2fe tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:54.406113 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-33a129a3-fd37-48fb-948b-9eb92c38f2fe tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:54.407499 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-33a129a3-fd37-48fb-948b-9eb92c38f2fe tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1724 microversion: 2.20 time: 0.410864 Jan 18 16:34:54.408052 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 346/680] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:34:53 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1724 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:34:54.569466 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-ecc435bd-bc43-4595-b460-d42b9279aa04 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:54.570077 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-ecc435bd-bc43-4595-b460-d42b9279aa04 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:54.576792 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ecc435bd-bc43-4595-b460-d42b9279aa04 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:54.577273 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ecc435bd-bc43-4595-b460-d42b9279aa04 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:54.578066 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ecc435bd-bc43-4595-b460-d42b9279aa04 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:54.578501 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ecc435bd-bc43-4595-b460-d42b9279aa04 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:54.851231 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-ecc435bd-bc43-4595-b460-d42b9279aa04 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0509d42df8844400b99d7c060ab98c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:54.860969 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-ecc435bd-bc43-4595-b460-d42b9279aa04 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 200 len: 1757 microversion: 2.1 time: 0.295271 Jan 18 16:34:54.862138 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 335/681] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:34:54 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 1757 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:34:54.928106 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [req-cc3630dc-e8cf-4c25-9fe8-a9ff073e4b57 req-b8d51d63-8ba2-4abd-b6f8-a82d8c1ccd0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e9ca525-aad0-4ac6-8879-2c8d0131c2ee", "name": "network-vif-deleted", "tag": "ca2a0420-8660-4c5a-8bc5-c3d7fa2913eb"}]} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:34:54.929843 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:34:54.929843 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: warnings.warn(msg) Jan 18 16:34:54.939583 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-cc3630dc-e8cf-4c25-9fe8-a9ff073e4b57 req-b8d51d63-8ba2-4abd-b6f8-a82d8c1ccd0e service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:54.940103 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-cc3630dc-e8cf-4c25-9fe8-a9ff073e4b57 req-b8d51d63-8ba2-4abd-b6f8-a82d8c1ccd0e service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:54.953487 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.compute.server_external_events [req-cc3630dc-e8cf-4c25-9fe8-a9ff073e4b57 req-b8d51d63-8ba2-4abd-b6f8-a82d8c1ccd0e service nova] Creating event network-vif-deleted:ca2a0420-8660-4c5a-8bc5-c3d7fa2913eb for instance 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee on hv-cinder-78836 Jan 18 16:34:54.959259 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [req-cc3630dc-e8cf-4c25-9fe8-a9ff073e4b57 req-b8d51d63-8ba2-4abd-b6f8-a82d8c1ccd0e service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035333 Jan 18 16:34:54.959943 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 347/682] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:34:55.426255 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-e2ce66b1-edeb-4807-bc1b-282dd251de9d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:55.426973 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-e2ce66b1-edeb-4807-bc1b-282dd251de9d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:55.433617 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e2ce66b1-edeb-4807-bc1b-282dd251de9d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:55.434057 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e2ce66b1-edeb-4807-bc1b-282dd251de9d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:55.434848 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e2ce66b1-edeb-4807-bc1b-282dd251de9d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:55.435254 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e2ce66b1-edeb-4807-bc1b-282dd251de9d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:55.466854 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e2ce66b1-edeb-4807-bc1b-282dd251de9d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:55.467294 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e2ce66b1-edeb-4807-bc1b-282dd251de9d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:55.467735 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.objects.instance [None req-e2ce66b1-edeb-4807-bc1b-282dd251de9d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lazy-loading 'fault' on Instance uuid 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee {{(pid=116368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 18 16:34:55.511391 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-e2ce66b1-edeb-4807-bc1b-282dd251de9d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:55.519209 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-e2ce66b1-edeb-4807-bc1b-282dd251de9d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:55.520753 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-e2ce66b1-edeb-4807-bc1b-282dd251de9d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:55.521920 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-e2ce66b1-edeb-4807-bc1b-282dd251de9d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1372 microversion: 2.20 time: 0.099500 Jan 18 16:34:55.522481 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 336/683] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:34:55 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1372 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:34:55.879992 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-9c72796b-4187-4940-a7af-d5ab08f79a10 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:55.880685 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-9c72796b-4187-4940-a7af-d5ab08f79a10 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:55.886907 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-9c72796b-4187-4940-a7af-d5ab08f79a10 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:55.887353 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-9c72796b-4187-4940-a7af-d5ab08f79a10 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:55.888129 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-9c72796b-4187-4940-a7af-d5ab08f79a10 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:55.888556 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-9c72796b-4187-4940-a7af-d5ab08f79a10 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:56.044728 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-9c72796b-4187-4940-a7af-d5ab08f79a10 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0509d42df8844400b99d7c060ab98c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:56.052523 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-9c72796b-4187-4940-a7af-d5ab08f79a10 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 200 len: 1757 microversion: 2.1 time: 0.177174 Jan 18 16:34:56.053114 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 348/684] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:34:55 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:34:56.541291 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-36d4d620-5336-4ccc-81ab-bba291dd5e7d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:56.541884 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-36d4d620-5336-4ccc-81ab-bba291dd5e7d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:56.548161 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-36d4d620-5336-4ccc-81ab-bba291dd5e7d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:56.548611 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-36d4d620-5336-4ccc-81ab-bba291dd5e7d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:56.549425 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-36d4d620-5336-4ccc-81ab-bba291dd5e7d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:56.549858 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-36d4d620-5336-4ccc-81ab-bba291dd5e7d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:56.580376 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-36d4d620-5336-4ccc-81ab-bba291dd5e7d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:56.580826 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-36d4d620-5336-4ccc-81ab-bba291dd5e7d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:56.581413 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.objects.instance [None req-36d4d620-5336-4ccc-81ab-bba291dd5e7d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lazy-loading 'fault' on Instance uuid 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee {{(pid=116368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 18 16:34:56.619775 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-36d4d620-5336-4ccc-81ab-bba291dd5e7d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:56.627893 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-36d4d620-5336-4ccc-81ab-bba291dd5e7d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:56.629422 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-36d4d620-5336-4ccc-81ab-bba291dd5e7d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:56.630606 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-36d4d620-5336-4ccc-81ab-bba291dd5e7d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1372 microversion: 2.20 time: 0.094116 Jan 18 16:34:56.631160 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 337/685] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:34:56 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:34:57.074159 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-d40b1c82-5ed8-47f3-98ea-1ead33f74a9d tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:57.074858 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-d40b1c82-5ed8-47f3-98ea-1ead33f74a9d tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:57.084837 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-d40b1c82-5ed8-47f3-98ea-1ead33f74a9d tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:57.085306 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-d40b1c82-5ed8-47f3-98ea-1ead33f74a9d tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:57.086113 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-d40b1c82-5ed8-47f3-98ea-1ead33f74a9d tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:57.086590 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-d40b1c82-5ed8-47f3-98ea-1ead33f74a9d tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:57.249868 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-d40b1c82-5ed8-47f3-98ea-1ead33f74a9d tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0509d42df8844400b99d7c060ab98c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:57.260701 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-d40b1c82-5ed8-47f3-98ea-1ead33f74a9d tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 200 len: 1757 microversion: 2.1 time: 0.191837 Jan 18 16:34:57.261442 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 349/686] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:34:57 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 1757 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:34:57.649425 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-89c668a2-eaa5-4be7-8b9e-ae73c9c62a9b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:57.650894 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-89c668a2-eaa5-4be7-8b9e-ae73c9c62a9b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:57.657411 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-89c668a2-eaa5-4be7-8b9e-ae73c9c62a9b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:57.657864 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-89c668a2-eaa5-4be7-8b9e-ae73c9c62a9b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:57.658670 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-89c668a2-eaa5-4be7-8b9e-ae73c9c62a9b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:57.659105 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-89c668a2-eaa5-4be7-8b9e-ae73c9c62a9b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:57.692655 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-89c668a2-eaa5-4be7-8b9e-ae73c9c62a9b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:57.693125 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-89c668a2-eaa5-4be7-8b9e-ae73c9c62a9b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:57.693565 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.objects.instance [None req-89c668a2-eaa5-4be7-8b9e-ae73c9c62a9b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lazy-loading 'fault' on Instance uuid 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee {{(pid=116368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 18 16:34:57.733482 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-89c668a2-eaa5-4be7-8b9e-ae73c9c62a9b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:57.741299 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-89c668a2-eaa5-4be7-8b9e-ae73c9c62a9b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:57.743380 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-89c668a2-eaa5-4be7-8b9e-ae73c9c62a9b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:57.744532 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-89c668a2-eaa5-4be7-8b9e-ae73c9c62a9b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 200 len: 1372 microversion: 2.20 time: 0.099600 Jan 18 16:34:57.745118 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 338/687] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:34:57 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 1372 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:34:58.284956 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-edbabfe4-abee-4c82-979f-cff66e557e54 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:58.285487 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-edbabfe4-abee-4c82-979f-cff66e557e54 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:58.292797 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-edbabfe4-abee-4c82-979f-cff66e557e54 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:58.293271 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-edbabfe4-abee-4c82-979f-cff66e557e54 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:58.294725 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-edbabfe4-abee-4c82-979f-cff66e557e54 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:58.295163 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-edbabfe4-abee-4c82-979f-cff66e557e54 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:58.456055 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-edbabfe4-abee-4c82-979f-cff66e557e54 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0509d42df8844400b99d7c060ab98c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:58.464977 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-edbabfe4-abee-4c82-979f-cff66e557e54 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 200 len: 1757 microversion: 2.1 time: 0.183734 Jan 18 16:34:58.465561 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 350/688] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:34:58 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 1757 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:34:58.762500 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-11059999-4ab7-4dc8-9123-eea65a162357 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:58.763519 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-11059999-4ab7-4dc8-9123-eea65a162357 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:58.769715 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-11059999-4ab7-4dc8-9123-eea65a162357 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:58.770164 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-11059999-4ab7-4dc8-9123-eea65a162357 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:58.770945 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-11059999-4ab7-4dc8-9123-eea65a162357 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:58.771390 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-11059999-4ab7-4dc8-9123-eea65a162357 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:58.785059 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.wsgi [None req-11059999-4ab7-4dc8-9123-eea65a162357 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] HTTP exception thrown: Instance 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee could not be found. Jan 18 16:34:58.785647 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-11059999-4ab7-4dc8-9123-eea65a162357 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Returning 404 to user: Instance 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee could not be found. {{(pid=116368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 16:34:58.786469 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-11059999-4ab7-4dc8-9123-eea65a162357 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 404 len: 111 microversion: 2.20 time: 0.028225 Jan 18 16:34:58.787043 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 339/689] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:34:58 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 18 16:34:58.795707 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-ce5f965d-1771-4889-8aab-51dc6cb1c243 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '.version_select at 0x7f33a507cb80>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:58.826617 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-ce5f965d-1771-4889-8aab-51dc6cb1c243 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1629316580" status: 204 len: 0 microversion: 2.20 time: 0.034392 Jan 18 16:34:58.827193 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 351/690] 10.222.0.82 () {60 vars in 1261 bytes} [Tue Jan 18 16:34:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1629316580 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 18 16:34:59.482971 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-8b63d9db-cdac-422e-ac74-375634070c69 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:34:59.483580 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-8b63d9db-cdac-422e-ac74-375634070c69 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:34:59.489397 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8b63d9db-cdac-422e-ac74-375634070c69 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:59.489844 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8b63d9db-cdac-422e-ac74-375634070c69 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:59.490616 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8b63d9db-cdac-422e-ac74-375634070c69 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:34:59.491046 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8b63d9db-cdac-422e-ac74-375634070c69 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:34:59.512415 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-fc4277a0-e88e-4fe1-9f75-975136e9e246 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'create', calling method: .version_select at 0x7f33a508d820>, body: {"keypair": {"name": "tempest-keypair-1190613664"}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:34:59.531216 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.quota [None req-fc4277a0-e88e-4fe1-9f75-975136e9e246 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Getting quotas for project 6ec6b09b84c64d969dd91ab88dc56e8c. Resources: {'key_pairs'} {{(pid=116367) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 16:34:59.542140 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.quota [None req-fc4277a0-e88e-4fe1-9f75-975136e9e246 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Getting quotas for user 996b56c77ddc470e9ed536ae6936acbd and project 6ec6b09b84c64d969dd91ab88dc56e8c. Resources: {'key_pairs'} {{(pid=116367) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 16:34:59.644604 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-8b63d9db-cdac-422e-ac74-375634070c69 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0509d42df8844400b99d7c060ab98c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:34:59.652470 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-8b63d9db-cdac-422e-ac74-375634070c69 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 200 len: 1757 microversion: 2.1 time: 0.173541 Jan 18 16:34:59.653058 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 340/691] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:34:59 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:34:59.776442 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.quota [None req-fc4277a0-e88e-4fe1-9f75-975136e9e246 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Getting quotas for project 6ec6b09b84c64d969dd91ab88dc56e8c. Resources: {'key_pairs'} {{(pid=116367) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 16:34:59.779996 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.quota [None req-fc4277a0-e88e-4fe1-9f75-975136e9e246 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Getting quotas for user 996b56c77ddc470e9ed536ae6936acbd and project 6ec6b09b84c64d969dd91ab88dc56e8c. Resources: {'key_pairs'} {{(pid=116367) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 16:34:59.793747 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-fc4277a0-e88e-4fe1-9f75-975136e9e246 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.286566 Jan 18 16:34:59.794344 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 352/692] 10.222.0.82 () {62 vars in 1198 bytes} [Tue Jan 18 16:34:59 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 288 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Jan 18 16:35:00.670230 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-423b2cbb-f7e7-419f-9785-89a6c405ec2a tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:35:00.670973 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-423b2cbb-f7e7-419f-9785-89a6c405ec2a tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:00.677865 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-423b2cbb-f7e7-419f-9785-89a6c405ec2a tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:00.678435 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-423b2cbb-f7e7-419f-9785-89a6c405ec2a tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:00.679423 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-423b2cbb-f7e7-419f-9785-89a6c405ec2a tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:00.680624 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-423b2cbb-f7e7-419f-9785-89a6c405ec2a tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:01.060842 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-423b2cbb-f7e7-419f-9785-89a6c405ec2a tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0509d42df8844400b99d7c060ab98c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:01.068798 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-423b2cbb-f7e7-419f-9785-89a6c405ec2a tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 200 len: 1757 microversion: 2.1 time: 0.402623 Jan 18 16:35:01.069395 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 341/693] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:35:00 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 1757 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:35:01.617317 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-22769fe3-469a-4457-aee1-fe19e4c9a060 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1454826103", "imageRef": "900c4a9d-b6c6-451f-a509-eb4f4b49f459", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e334f1c7-d732-446e-8bed-e601fcceb421"}], "security_groups": [{"name": "tempest-securitygroup--962243680"}], "key_name": "tempest-keypair-1190613664", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:35:01.737949 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.network.neutron [None req-22769fe3-469a-4457-aee1-fe19e4c9a060 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] validate_networks() for [('e334f1c7-d732-446e-8bed-e601fcceb421', None, None, None, None, None)] {{(pid=116367) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 18 16:35:02.089840 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-7d588044-6cc4-442e-a0af-5edfeaa17ceb tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:35:02.090420 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-7d588044-6cc4-442e-a0af-5edfeaa17ceb tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:02.099859 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7d588044-6cc4-442e-a0af-5edfeaa17ceb tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:02.100549 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7d588044-6cc4-442e-a0af-5edfeaa17ceb tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:02.101811 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7d588044-6cc4-442e-a0af-5edfeaa17ceb tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:02.102484 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7d588044-6cc4-442e-a0af-5edfeaa17ceb tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:02.342461 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-7d588044-6cc4-442e-a0af-5edfeaa17ceb tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0509d42df8844400b99d7c060ab98c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:02.350116 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-7d588044-6cc4-442e-a0af-5edfeaa17ceb tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 200 len: 1757 microversion: 2.1 time: 0.266486 Jan 18 16:35:02.350695 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 342/694] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:35:02 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 1757 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:35:02.440280 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.virt.hardware [None req-22769fe3-469a-4457-aee1-fe19e4c9a060 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Flavor limits 0:0:0 {{(pid=116367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 18 16:35:02.440985 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.virt.hardware [None req-22769fe3-469a-4457-aee1-fe19e4c9a060 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Image limits 0:0:0 {{(pid=116367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 18 16:35:02.441462 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.virt.hardware [None req-22769fe3-469a-4457-aee1-fe19e4c9a060 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Flavor pref 0:0:0 {{(pid=116367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 18 16:35:02.441873 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.virt.hardware [None req-22769fe3-469a-4457-aee1-fe19e4c9a060 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Image pref 0:0:0 {{(pid=116367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 18 16:35:02.442283 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.virt.hardware [None req-22769fe3-469a-4457-aee1-fe19e4c9a060 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 18 16:35:02.451710 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-22769fe3-469a-4457-aee1-fe19e4c9a060 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:02.452153 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-22769fe3-469a-4457-aee1-fe19e4c9a060 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:02.452995 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-22769fe3-469a-4457-aee1-fe19e4c9a060 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:02.453431 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-22769fe3-469a-4457-aee1-fe19e4c9a060 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:02.469263 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.quota [None req-22769fe3-469a-4457-aee1-fe19e4c9a060 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Getting quotas for project 6ec6b09b84c64d969dd91ab88dc56e8c. Resources: {'ram', 'instances', 'cores'} {{(pid=116367) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 16:35:02.473149 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.quota [None req-22769fe3-469a-4457-aee1-fe19e4c9a060 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Getting quotas for user 996b56c77ddc470e9ed536ae6936acbd and project 6ec6b09b84c64d969dd91ab88dc56e8c. Resources: {'ram', 'instances', 'cores'} {{(pid=116367) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 16:35:02.483674 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-22769fe3-469a-4457-aee1-fe19e4c9a060 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Going to run 1 instances... {{(pid=116367) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 18 16:35:02.485991 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-22769fe3-469a-4457-aee1-fe19e4c9a060 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='900c4a9d-b6c6-451f-a509-eb4f4b49f459',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 18 16:35:02.531051 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-22769fe3-469a-4457-aee1-fe19e4c9a060 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.918236 Jan 18 16:35:02.531705 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 353/695] 10.222.0.82 () {62 vars in 1187 bytes} [Tue Jan 18 16:35:01 2022] POST /compute/v2.1/servers => generated 401 bytes in 919 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 18 16:35:02.541995 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-71a0ab1f-2feb-47c5-926f-89dafd7e5941 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:35:02.542830 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-71a0ab1f-2feb-47c5-926f-89dafd7e5941 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:02.594103 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-71a0ab1f-2feb-47c5-926f-89dafd7e5941 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:02.601076 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-71a0ab1f-2feb-47c5-926f-89dafd7e5941 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:02.603350 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-71a0ab1f-2feb-47c5-926f-89dafd7e5941 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:02.604449 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-71a0ab1f-2feb-47c5-926f-89dafd7e5941 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc" status: 200 len: 1282 microversion: 2.20 time: 0.066734 Jan 18 16:35:02.605028 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 343/696] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:35:02 2022] GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc => generated 1282 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 16:35:03.366711 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-137f65f8-fdf5-4d7f-9907-f2587cea8f85 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:35:03.367317 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-137f65f8-fdf5-4d7f-9907-f2587cea8f85 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:03.373753 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-137f65f8-fdf5-4d7f-9907-f2587cea8f85 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:03.374209 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-137f65f8-fdf5-4d7f-9907-f2587cea8f85 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:03.374984 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-137f65f8-fdf5-4d7f-9907-f2587cea8f85 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:03.375422 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-137f65f8-fdf5-4d7f-9907-f2587cea8f85 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:03.525858 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-137f65f8-fdf5-4d7f-9907-f2587cea8f85 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0509d42df8844400b99d7c060ab98c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:03.533955 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-137f65f8-fdf5-4d7f-9907-f2587cea8f85 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 200 len: 1757 microversion: 2.1 time: 0.171376 Jan 18 16:35:03.534759 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 354/697] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:35:03 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:35:03.622545 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-02a5f15a-e497-4bc4-9dda-195a4a0fcce6 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:35:03.623109 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-02a5f15a-e497-4bc4-9dda-195a4a0fcce6 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:03.630272 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-02a5f15a-e497-4bc4-9dda-195a4a0fcce6 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:03.630714 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-02a5f15a-e497-4bc4-9dda-195a4a0fcce6 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:03.631672 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-02a5f15a-e497-4bc4-9dda-195a4a0fcce6 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:03.632124 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-02a5f15a-e497-4bc4-9dda-195a4a0fcce6 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:03.710463 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-02a5f15a-e497-4bc4-9dda-195a4a0fcce6 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:03.720240 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-02a5f15a-e497-4bc4-9dda-195a4a0fcce6 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:03.723079 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-02a5f15a-e497-4bc4-9dda-195a4a0fcce6 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:03.724260 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-02a5f15a-e497-4bc4-9dda-195a4a0fcce6 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc" status: 200 len: 1352 microversion: 2.20 time: 0.105559 Jan 18 16:35:03.724813 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 344/698] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:35:03 2022] GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc => generated 1352 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 16:35:04.551292 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-bbb9f778-19d2-4126-bfad-1b9b42ed2f24 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:35:04.551950 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-bbb9f778-19d2-4126-bfad-1b9b42ed2f24 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:04.558668 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-bbb9f778-19d2-4126-bfad-1b9b42ed2f24 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:04.559108 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-bbb9f778-19d2-4126-bfad-1b9b42ed2f24 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:04.559884 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-bbb9f778-19d2-4126-bfad-1b9b42ed2f24 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:04.560565 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-bbb9f778-19d2-4126-bfad-1b9b42ed2f24 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:04.742259 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-ebea8207-aaf6-437a-9b3b-39cf0b73656a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:35:04.743373 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-ebea8207-aaf6-437a-9b3b-39cf0b73656a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:04.750485 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ebea8207-aaf6-437a-9b3b-39cf0b73656a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:04.753070 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ebea8207-aaf6-437a-9b3b-39cf0b73656a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:04.753901 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ebea8207-aaf6-437a-9b3b-39cf0b73656a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:04.754345 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ebea8207-aaf6-437a-9b3b-39cf0b73656a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:04.836781 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-bbb9f778-19d2-4126-bfad-1b9b42ed2f24 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0509d42df8844400b99d7c060ab98c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:04.846826 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-bbb9f778-19d2-4126-bfad-1b9b42ed2f24 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 200 len: 1757 microversion: 2.1 time: 0.299236 Jan 18 16:35:04.847418 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 355/699] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:35:04 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 1757 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:35:05.061945 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-ebea8207-aaf6-437a-9b3b-39cf0b73656a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:05.073906 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-ebea8207-aaf6-437a-9b3b-39cf0b73656a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:05.076464 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-ebea8207-aaf6-437a-9b3b-39cf0b73656a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:05.078115 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-ebea8207-aaf6-437a-9b3b-39cf0b73656a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc" status: 200 len: 1407 microversion: 2.20 time: 0.339702 Jan 18 16:35:05.079197 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 345/700] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:35:04 2022] GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc => generated 1407 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 16:35:05.220460 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [req-dc51f6ea-f6d0-4cfc-bbcd-6ad2529bc0f9 req-d8b48eea-5dd8-4ee1-a3bc-aed1a48fe01a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d44a3a6-2027-437a-86a6-a826f997f8fc", "tag": "3214e15a-2bf8-4e9c-b215-8b914b1912ec"}]} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:35:05.222108 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:35:05.222108 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: warnings.warn(msg) Jan 18 16:35:05.236381 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-dc51f6ea-f6d0-4cfc-bbcd-6ad2529bc0f9 req-d8b48eea-5dd8-4ee1-a3bc-aed1a48fe01a service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:05.237569 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-dc51f6ea-f6d0-4cfc-bbcd-6ad2529bc0f9 req-d8b48eea-5dd8-4ee1-a3bc-aed1a48fe01a service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:05.260883 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.compute.server_external_events [req-dc51f6ea-f6d0-4cfc-bbcd-6ad2529bc0f9 req-d8b48eea-5dd8-4ee1-a3bc-aed1a48fe01a service nova] Creating event network-changed:3214e15a-2bf8-4e9c-b215-8b914b1912ec for instance 0d44a3a6-2027-437a-86a6-a826f997f8fc on hv-cinder-78836 Jan 18 16:35:05.267243 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [req-dc51f6ea-f6d0-4cfc-bbcd-6ad2529bc0f9 req-d8b48eea-5dd8-4ee1-a3bc-aed1a48fe01a service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051153 Jan 18 16:35:05.267849 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 356/701] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:35:05.864039 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-71c2be76-7f1b-48e6-8f63-d40fb54b1f1a tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:35:05.864772 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-71c2be76-7f1b-48e6-8f63-d40fb54b1f1a tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:05.871135 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-71c2be76-7f1b-48e6-8f63-d40fb54b1f1a tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:05.871676 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-71c2be76-7f1b-48e6-8f63-d40fb54b1f1a tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:05.872375 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-71c2be76-7f1b-48e6-8f63-d40fb54b1f1a tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:05.872817 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-71c2be76-7f1b-48e6-8f63-d40fb54b1f1a tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:06.073012 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-71c2be76-7f1b-48e6-8f63-d40fb54b1f1a tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0509d42df8844400b99d7c060ab98c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:06.081534 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-71c2be76-7f1b-48e6-8f63-d40fb54b1f1a tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 200 len: 1757 microversion: 2.1 time: 0.221128 Jan 18 16:35:06.082113 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 346/702] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:35:05 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 1757 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:35:06.167031 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-85591c0d-da72-4609-815e-ce460b199286 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:35:06.167996 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-85591c0d-da72-4609-815e-ce460b199286 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:06.177531 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-85591c0d-da72-4609-815e-ce460b199286 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:06.178194 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-85591c0d-da72-4609-815e-ce460b199286 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:06.179336 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-85591c0d-da72-4609-815e-ce460b199286 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:06.180682 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-85591c0d-da72-4609-815e-ce460b199286 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:06.353170 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-85591c0d-da72-4609-815e-ce460b199286 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:06.355246 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-85591c0d-da72-4609-815e-ce460b199286 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:06.356709 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-85591c0d-da72-4609-815e-ce460b199286 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:06.357927 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-85591c0d-da72-4609-815e-ce460b199286 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc" status: 200 len: 1407 microversion: 2.20 time: 0.262839 Jan 18 16:35:06.358802 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 357/703] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:35:06 2022] GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc => generated 1407 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 16:35:07.098493 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-8aff3033-04f9-4097-a317-963a3a0474ce tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:35:07.099100 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-8aff3033-04f9-4097-a317-963a3a0474ce tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:07.105664 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8aff3033-04f9-4097-a317-963a3a0474ce tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:07.106115 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8aff3033-04f9-4097-a317-963a3a0474ce tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:07.106898 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8aff3033-04f9-4097-a317-963a3a0474ce tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:07.107338 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8aff3033-04f9-4097-a317-963a3a0474ce tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:07.254115 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-8aff3033-04f9-4097-a317-963a3a0474ce tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0509d42df8844400b99d7c060ab98c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:07.262371 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-8aff3033-04f9-4097-a317-963a3a0474ce tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 200 len: 1757 microversion: 2.1 time: 0.167568 Jan 18 16:35:07.262927 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 347/704] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:35:07 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:35:07.375296 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-43863e53-e763-44c9-90a2-6bb220c75c5d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:35:07.375909 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-43863e53-e763-44c9-90a2-6bb220c75c5d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:07.382209 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-43863e53-e763-44c9-90a2-6bb220c75c5d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:07.383142 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-43863e53-e763-44c9-90a2-6bb220c75c5d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:07.384286 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-43863e53-e763-44c9-90a2-6bb220c75c5d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:07.384715 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-43863e53-e763-44c9-90a2-6bb220c75c5d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:07.523818 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-43863e53-e763-44c9-90a2-6bb220c75c5d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:07.531457 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-43863e53-e763-44c9-90a2-6bb220c75c5d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:07.533086 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-43863e53-e763-44c9-90a2-6bb220c75c5d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:07.534166 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-43863e53-e763-44c9-90a2-6bb220c75c5d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc" status: 200 len: 1407 microversion: 2.20 time: 0.162538 Jan 18 16:35:07.534723 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 358/705] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:35:07 2022] GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:35:08.278996 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-e414e8ea-a635-45d0-9f65-33f04a840299 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:35:08.279636 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-e414e8ea-a635-45d0-9f65-33f04a840299 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:08.285880 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e414e8ea-a635-45d0-9f65-33f04a840299 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:08.286327 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e414e8ea-a635-45d0-9f65-33f04a840299 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:08.287104 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e414e8ea-a635-45d0-9f65-33f04a840299 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:08.287541 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e414e8ea-a635-45d0-9f65-33f04a840299 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:08.433625 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-e414e8ea-a635-45d0-9f65-33f04a840299 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0509d42df8844400b99d7c060ab98c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:08.441612 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-e414e8ea-a635-45d0-9f65-33f04a840299 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 200 len: 1757 microversion: 2.1 time: 0.166264 Jan 18 16:35:08.442180 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 348/706] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:35:08 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:35:08.551221 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-aa855cf4-dbb2-47e6-b736-0b6e69fe9f11 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:35:08.551805 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-aa855cf4-dbb2-47e6-b736-0b6e69fe9f11 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:08.558563 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-aa855cf4-dbb2-47e6-b736-0b6e69fe9f11 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:08.559005 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-aa855cf4-dbb2-47e6-b736-0b6e69fe9f11 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:08.559781 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-aa855cf4-dbb2-47e6-b736-0b6e69fe9f11 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:08.560206 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-aa855cf4-dbb2-47e6-b736-0b6e69fe9f11 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:08.762648 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-aa855cf4-dbb2-47e6-b736-0b6e69fe9f11 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:08.771257 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-aa855cf4-dbb2-47e6-b736-0b6e69fe9f11 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:08.772793 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-aa855cf4-dbb2-47e6-b736-0b6e69fe9f11 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:08.774735 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-aa855cf4-dbb2-47e6-b736-0b6e69fe9f11 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc" status: 200 len: 1407 microversion: 2.20 time: 0.227089 Jan 18 16:35:08.785000 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 359/707] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:35:08 2022] GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc => generated 1407 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:35:09.459227 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-f1becef8-3f06-4043-8998-64afbe2347e0 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:35:09.459832 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-f1becef8-3f06-4043-8998-64afbe2347e0 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:09.467545 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f1becef8-3f06-4043-8998-64afbe2347e0 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:09.468273 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f1becef8-3f06-4043-8998-64afbe2347e0 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:09.469260 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f1becef8-3f06-4043-8998-64afbe2347e0 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:09.469843 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f1becef8-3f06-4043-8998-64afbe2347e0 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:09.646692 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-f1becef8-3f06-4043-8998-64afbe2347e0 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0509d42df8844400b99d7c060ab98c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:09.655877 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-f1becef8-3f06-4043-8998-64afbe2347e0 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 200 len: 1760 microversion: 2.1 time: 0.200224 Jan 18 16:35:09.656463 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 349/708] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:35:09 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 1760 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:35:09.791659 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-fbd836bd-c1de-43cb-994f-aafdbcf9c561 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:35:09.792220 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-fbd836bd-c1de-43cb-994f-aafdbcf9c561 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:09.798373 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-fbd836bd-c1de-43cb-994f-aafdbcf9c561 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:09.798850 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-fbd836bd-c1de-43cb-994f-aafdbcf9c561 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:09.799629 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-fbd836bd-c1de-43cb-994f-aafdbcf9c561 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:09.800060 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-fbd836bd-c1de-43cb-994f-aafdbcf9c561 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:09.927749 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-fbd836bd-c1de-43cb-994f-aafdbcf9c561 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:09.935962 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-fbd836bd-c1de-43cb-994f-aafdbcf9c561 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:09.937485 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-fbd836bd-c1de-43cb-994f-aafdbcf9c561 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:09.938584 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-fbd836bd-c1de-43cb-994f-aafdbcf9c561 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc" status: 200 len: 1407 microversion: 2.20 time: 0.150789 Jan 18 16:35:09.939135 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 360/709] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:35:09 2022] GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:35:10.957305 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-274d3f16-59d9-4d53-874f-70de1245766e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:35:10.957987 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-274d3f16-59d9-4d53-874f-70de1245766e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:10.964438 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-274d3f16-59d9-4d53-874f-70de1245766e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:10.964884 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-274d3f16-59d9-4d53-874f-70de1245766e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:10.965690 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-274d3f16-59d9-4d53-874f-70de1245766e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:10.966120 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-274d3f16-59d9-4d53-874f-70de1245766e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:11.093405 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [req-ad05b0af-a5c5-4f00-a269-43bc6b797416 req-b35b5bec-4aa8-4055-9d80-85ae07e4c898 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d44a3a6-2027-437a-86a6-a826f997f8fc", "name": "network-vif-plugged", "status": "completed", "tag": "3214e15a-2bf8-4e9c-b215-8b914b1912ec"}]} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:35:11.095898 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:35:11.095898 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: warnings.warn(msg) Jan 18 16:35:11.105848 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-274d3f16-59d9-4d53-874f-70de1245766e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:11.110753 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-ad05b0af-a5c5-4f00-a269-43bc6b797416 req-b35b5bec-4aa8-4055-9d80-85ae07e4c898 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:11.111204 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-ad05b0af-a5c5-4f00-a269-43bc6b797416 req-b35b5bec-4aa8-4055-9d80-85ae07e4c898 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:11.114484 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-274d3f16-59d9-4d53-874f-70de1245766e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:11.116076 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-274d3f16-59d9-4d53-874f-70de1245766e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:11.117890 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-274d3f16-59d9-4d53-874f-70de1245766e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc" status: 200 len: 1407 microversion: 2.20 time: 0.163794 Jan 18 16:35:11.118994 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 350/710] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:35:10 2022] GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:35:11.130874 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.compute.server_external_events [req-ad05b0af-a5c5-4f00-a269-43bc6b797416 req-b35b5bec-4aa8-4055-9d80-85ae07e4c898 service nova] Creating event network-vif-plugged:3214e15a-2bf8-4e9c-b215-8b914b1912ec for instance 0d44a3a6-2027-437a-86a6-a826f997f8fc on hv-cinder-78836 Jan 18 16:35:11.136314 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [req-ad05b0af-a5c5-4f00-a269-43bc6b797416 req-b35b5bec-4aa8-4055-9d80-85ae07e4c898 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047194 Jan 18 16:35:11.136986 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 361/711] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 16:35:12.136004 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-a7891b82-3769-4db3-b6bd-a0e6f08ac33f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:35:12.136604 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-a7891b82-3769-4db3-b6bd-a0e6f08ac33f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:12.142778 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a7891b82-3769-4db3-b6bd-a0e6f08ac33f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:12.143247 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a7891b82-3769-4db3-b6bd-a0e6f08ac33f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:12.144017 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a7891b82-3769-4db3-b6bd-a0e6f08ac33f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:12.144446 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a7891b82-3769-4db3-b6bd-a0e6f08ac33f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:12.275271 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-a7891b82-3769-4db3-b6bd-a0e6f08ac33f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:12.282992 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-a7891b82-3769-4db3-b6bd-a0e6f08ac33f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:12.284490 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-a7891b82-3769-4db3-b6bd-a0e6f08ac33f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:12.285620 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-a7891b82-3769-4db3-b6bd-a0e6f08ac33f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc" status: 200 len: 1407 microversion: 2.20 time: 0.154023 Jan 18 16:35:12.286171 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 351/712] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:35:12 2022] GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:35:13.305200 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-5ed77aad-f7eb-4ea1-8607-37f85eaf132a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:35:13.305884 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-5ed77aad-f7eb-4ea1-8607-37f85eaf132a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:13.311894 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-5ed77aad-f7eb-4ea1-8607-37f85eaf132a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:13.312342 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-5ed77aad-f7eb-4ea1-8607-37f85eaf132a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:13.313144 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-5ed77aad-f7eb-4ea1-8607-37f85eaf132a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:13.313579 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-5ed77aad-f7eb-4ea1-8607-37f85eaf132a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:13.443214 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-5ed77aad-f7eb-4ea1-8607-37f85eaf132a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:13.451983 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-5ed77aad-f7eb-4ea1-8607-37f85eaf132a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:13.453503 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-5ed77aad-f7eb-4ea1-8607-37f85eaf132a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:13.454634 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-5ed77aad-f7eb-4ea1-8607-37f85eaf132a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc" status: 200 len: 1600 microversion: 2.20 time: 0.154013 Jan 18 16:35:13.455187 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 362/713] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:35:13 2022] GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:35:13.471903 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-15a255bf-47b4-46dc-8f9c-15c9e9bbb6db tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:35:13.472411 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-15a255bf-47b4-46dc-8f9c-15c9e9bbb6db tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:13.478607 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-15a255bf-47b4-46dc-8f9c-15c9e9bbb6db tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:13.479058 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-15a255bf-47b4-46dc-8f9c-15c9e9bbb6db tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:13.479836 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-15a255bf-47b4-46dc-8f9c-15c9e9bbb6db tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:13.480279 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-15a255bf-47b4-46dc-8f9c-15c9e9bbb6db tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:13.560562 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-15a255bf-47b4-46dc-8f9c-15c9e9bbb6db tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.092315 Jan 18 16:35:13.561214 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 352/714] 10.222.0.82 () {60 vars in 1315 bytes} [Tue Jan 18 16:35:13 2022] GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:35:14.758463 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-4947ff99-b2bd-4006-8ff4-4c9195d56322 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:35:14.759713 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-4947ff99-b2bd-4006-8ff4-4c9195d56322 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:14.760605 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [req-d161c04f-d85d-487a-8508-8ce2d0d58fec req-d52ce250-11ca-4cc9-94d2-bf51729b138c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d44a3a6-2027-437a-86a6-a826f997f8fc", "tag": "3214e15a-2bf8-4e9c-b215-8b914b1912ec"}]} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:35:14.762409 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:35:14.762409 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: warnings.warn(msg) Jan 18 16:35:14.766015 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4947ff99-b2bd-4006-8ff4-4c9195d56322 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:14.766462 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4947ff99-b2bd-4006-8ff4-4c9195d56322 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:14.767243 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4947ff99-b2bd-4006-8ff4-4c9195d56322 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:14.767673 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4947ff99-b2bd-4006-8ff4-4c9195d56322 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:14.770632 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-d161c04f-d85d-487a-8508-8ce2d0d58fec req-d52ce250-11ca-4cc9-94d2-bf51729b138c service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:14.771194 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-d161c04f-d85d-487a-8508-8ce2d0d58fec req-d52ce250-11ca-4cc9-94d2-bf51729b138c service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:14.783172 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.compute.server_external_events [req-d161c04f-d85d-487a-8508-8ce2d0d58fec req-d52ce250-11ca-4cc9-94d2-bf51729b138c service nova] Creating event network-changed:3214e15a-2bf8-4e9c-b215-8b914b1912ec for instance 0d44a3a6-2027-437a-86a6-a826f997f8fc on hv-cinder-78836 Jan 18 16:35:14.790526 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [req-d161c04f-d85d-487a-8508-8ce2d0d58fec req-d52ce250-11ca-4cc9-94d2-bf51729b138c service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034194 Jan 18 16:35:14.791325 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 353/715] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:35:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:35:14.828758 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-4947ff99-b2bd-4006-8ff4-4c9195d56322 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action" status: 200 len: 14 microversion: 2.20 time: 0.074531 Jan 18 16:35:14.832142 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 363/716] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:35:14 2022] POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:35:15.841334 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-3a8f1372-178f-4fa0-9dc5-869a98e66ce9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:35:15.842272 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-3a8f1372-178f-4fa0-9dc5-869a98e66ce9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:15.848352 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3a8f1372-178f-4fa0-9dc5-869a98e66ce9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:15.848789 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3a8f1372-178f-4fa0-9dc5-869a98e66ce9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:15.849777 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3a8f1372-178f-4fa0-9dc5-869a98e66ce9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:15.850204 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3a8f1372-178f-4fa0-9dc5-869a98e66ce9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:15.909416 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-3a8f1372-178f-4fa0-9dc5-869a98e66ce9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action" status: 200 len: 14 microversion: 2.20 time: 0.073190 Jan 18 16:35:15.910219 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 354/717] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:35:15 2022] POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:35:16.920384 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-849be9df-2ca0-4e2d-a105-5643f01d3efb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:35:16.921390 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-849be9df-2ca0-4e2d-a105-5643f01d3efb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:16.928302 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-849be9df-2ca0-4e2d-a105-5643f01d3efb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:16.928762 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-849be9df-2ca0-4e2d-a105-5643f01d3efb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:16.929585 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-849be9df-2ca0-4e2d-a105-5643f01d3efb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:16.930006 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-849be9df-2ca0-4e2d-a105-5643f01d3efb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:16.990048 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-849be9df-2ca0-4e2d-a105-5643f01d3efb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action" status: 200 len: 14 microversion: 2.20 time: 0.073560 Jan 18 16:35:16.990654 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 364/718] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:35:16 2022] POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:35:18.001305 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-c0e8bfbc-9440-4c04-84a3-489647e926dc tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:35:18.002320 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-c0e8bfbc-9440-4c04-84a3-489647e926dc tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:18.010088 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c0e8bfbc-9440-4c04-84a3-489647e926dc tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:18.010544 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c0e8bfbc-9440-4c04-84a3-489647e926dc tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:18.011321 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c0e8bfbc-9440-4c04-84a3-489647e926dc tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:18.011755 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c0e8bfbc-9440-4c04-84a3-489647e926dc tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:18.069543 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-c0e8bfbc-9440-4c04-84a3-489647e926dc tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action" status: 200 len: 14 microversion: 2.20 time: 0.072264 Jan 18 16:35:18.070231 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 355/719] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:35:17 2022] POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:35:19.080908 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-43f88319-8bff-4afc-a7f7-cf6420c0fb11 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:35:19.081918 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-43f88319-8bff-4afc-a7f7-cf6420c0fb11 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:19.089814 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-43f88319-8bff-4afc-a7f7-cf6420c0fb11 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:19.090262 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-43f88319-8bff-4afc-a7f7-cf6420c0fb11 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:19.091038 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-43f88319-8bff-4afc-a7f7-cf6420c0fb11 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:19.091470 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-43f88319-8bff-4afc-a7f7-cf6420c0fb11 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:19.155710 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-43f88319-8bff-4afc-a7f7-cf6420c0fb11 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action" status: 200 len: 14 microversion: 2.20 time: 0.078690 Jan 18 16:35:19.156816 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 365/720] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:35:19 2022] POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:35:20.167211 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-10d4cf44-e375-4f75-8d55-37b3175cf49a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:35:20.168204 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-10d4cf44-e375-4f75-8d55-37b3175cf49a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:20.175129 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-10d4cf44-e375-4f75-8d55-37b3175cf49a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:20.175580 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-10d4cf44-e375-4f75-8d55-37b3175cf49a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:20.176352 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-10d4cf44-e375-4f75-8d55-37b3175cf49a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:20.176788 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-10d4cf44-e375-4f75-8d55-37b3175cf49a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:20.247995 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-10d4cf44-e375-4f75-8d55-37b3175cf49a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action" status: 200 len: 14 microversion: 2.20 time: 0.084790 Jan 18 16:35:20.248621 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 356/721] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:35:20 2022] POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:35:21.260505 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-1ccb7e98-eccb-49d3-af94-aabb89bad959 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:35:21.261584 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-1ccb7e98-eccb-49d3-af94-aabb89bad959 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:21.268367 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-1ccb7e98-eccb-49d3-af94-aabb89bad959 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:21.268815 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-1ccb7e98-eccb-49d3-af94-aabb89bad959 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:21.269614 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-1ccb7e98-eccb-49d3-af94-aabb89bad959 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:21.270052 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-1ccb7e98-eccb-49d3-af94-aabb89bad959 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:21.332177 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-1ccb7e98-eccb-49d3-af94-aabb89bad959 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action" status: 200 len: 14 microversion: 2.20 time: 0.076345 Jan 18 16:35:21.332814 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 366/722] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:35:21 2022] POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:35:22.343673 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-59ff8335-2fbe-4c13-9dad-82c0b40b72b1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:35:22.344679 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-59ff8335-2fbe-4c13-9dad-82c0b40b72b1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:22.351595 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-59ff8335-2fbe-4c13-9dad-82c0b40b72b1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:22.351988 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-59ff8335-2fbe-4c13-9dad-82c0b40b72b1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:22.352753 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-59ff8335-2fbe-4c13-9dad-82c0b40b72b1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:22.353210 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-59ff8335-2fbe-4c13-9dad-82c0b40b72b1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:22.411100 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-59ff8335-2fbe-4c13-9dad-82c0b40b72b1 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action" status: 200 len: 14 microversion: 2.20 time: 0.071413 Jan 18 16:35:22.411726 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 357/723] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:35:22 2022] POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:35:23.422311 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-938ffe65-d002-4e00-8197-dc5cf9cb0866 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:35:23.423327 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-938ffe65-d002-4e00-8197-dc5cf9cb0866 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:23.430582 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-938ffe65-d002-4e00-8197-dc5cf9cb0866 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:23.431018 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-938ffe65-d002-4e00-8197-dc5cf9cb0866 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:23.431909 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-938ffe65-d002-4e00-8197-dc5cf9cb0866 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:23.432338 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-938ffe65-d002-4e00-8197-dc5cf9cb0866 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:23.493364 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-938ffe65-d002-4e00-8197-dc5cf9cb0866 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action" status: 200 len: 14 microversion: 2.20 time: 0.074899 Jan 18 16:35:23.493878 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 367/724] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:35:23 2022] POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:35:24.504606 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-ed7aef67-349d-4a03-b887-de933e05d3e2 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:35:24.505609 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-ed7aef67-349d-4a03-b887-de933e05d3e2 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:24.513021 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ed7aef67-349d-4a03-b887-de933e05d3e2 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:24.513464 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ed7aef67-349d-4a03-b887-de933e05d3e2 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:24.514227 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ed7aef67-349d-4a03-b887-de933e05d3e2 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:24.514654 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ed7aef67-349d-4a03-b887-de933e05d3e2 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:24.575621 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-ed7aef67-349d-4a03-b887-de933e05d3e2 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action" status: 200 len: 14 microversion: 2.20 time: 0.074914 Jan 18 16:35:24.576221 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 358/725] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:35:24 2022] POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:35:25.587625 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-37fcd4e3-e92b-4b3d-993a-a831cf8c54ef tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:35:25.588532 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-37fcd4e3-e92b-4b3d-993a-a831cf8c54ef tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:25.595358 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-37fcd4e3-e92b-4b3d-993a-a831cf8c54ef tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:25.595806 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-37fcd4e3-e92b-4b3d-993a-a831cf8c54ef tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:25.596584 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-37fcd4e3-e92b-4b3d-993a-a831cf8c54ef tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:25.597046 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-37fcd4e3-e92b-4b3d-993a-a831cf8c54ef tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:25.666240 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-37fcd4e3-e92b-4b3d-993a-a831cf8c54ef tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action" status: 200 len: 10009 microversion: 2.20 time: 0.083059 Jan 18 16:35:25.666864 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 368/726] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:35:25 2022] POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action => generated 10009 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:35:26.678492 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-95368db5-7a93-4fd8-9825-69e1918074bd tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:35:26.680589 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-95368db5-7a93-4fd8-9825-69e1918074bd tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:26.687455 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-95368db5-7a93-4fd8-9825-69e1918074bd tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:26.687907 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-95368db5-7a93-4fd8-9825-69e1918074bd tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:26.688690 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-95368db5-7a93-4fd8-9825-69e1918074bd tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:26.689151 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-95368db5-7a93-4fd8-9825-69e1918074bd tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:26.762833 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-95368db5-7a93-4fd8-9825-69e1918074bd tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action" status: 200 len: 16721 microversion: 2.20 time: 0.088521 Jan 18 16:35:26.763508 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 359/727] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:35:26 2022] POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action => generated 16721 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:35:27.774893 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-051ccec4-0b10-44c6-ae44-536b98d8f67c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:35:27.775923 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-051ccec4-0b10-44c6-ae44-536b98d8f67c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:27.782741 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-051ccec4-0b10-44c6-ae44-536b98d8f67c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:27.783186 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-051ccec4-0b10-44c6-ae44-536b98d8f67c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:27.783962 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-051ccec4-0b10-44c6-ae44-536b98d8f67c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:27.784397 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-051ccec4-0b10-44c6-ae44-536b98d8f67c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:27.854674 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-051ccec4-0b10-44c6-ae44-536b98d8f67c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action" status: 200 len: 18498 microversion: 2.20 time: 0.084404 Jan 18 16:35:27.855315 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 369/728] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:35:27 2022] POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action => generated 18498 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:35:28.865985 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-7c8fcbea-34a2-4155-ae7d-d655d723f3ea tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:35:28.867922 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-7c8fcbea-34a2-4155-ae7d-d655d723f3ea tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:28.874780 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7c8fcbea-34a2-4155-ae7d-d655d723f3ea tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:28.875228 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7c8fcbea-34a2-4155-ae7d-d655d723f3ea tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:28.875999 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7c8fcbea-34a2-4155-ae7d-d655d723f3ea tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:28.876429 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7c8fcbea-34a2-4155-ae7d-d655d723f3ea tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:28.948354 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-7c8fcbea-34a2-4155-ae7d-d655d723f3ea tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action" status: 200 len: 20997 microversion: 2.20 time: 0.086184 Jan 18 16:35:28.949107 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 360/729] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:35:28 2022] POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action => generated 20997 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:35:29.960366 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-0a6c8e82-95f9-49c4-a509-8a87305eb5b4 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:35:29.961843 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-0a6c8e82-95f9-49c4-a509-8a87305eb5b4 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:29.968661 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0a6c8e82-95f9-49c4-a509-8a87305eb5b4 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:29.969149 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0a6c8e82-95f9-49c4-a509-8a87305eb5b4 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:29.969928 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0a6c8e82-95f9-49c4-a509-8a87305eb5b4 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:29.970380 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0a6c8e82-95f9-49c4-a509-8a87305eb5b4 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:30.041978 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-0a6c8e82-95f9-49c4-a509-8a87305eb5b4 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action" status: 200 len: 22770 microversion: 2.20 time: 0.085778 Jan 18 16:35:30.042600 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 370/730] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:35:29 2022] POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action => generated 22770 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:35:31.054697 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-ad917a22-269e-47ba-a8e4-5702916d22e4 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:35:31.055654 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-ad917a22-269e-47ba-a8e4-5702916d22e4 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:31.062461 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ad917a22-269e-47ba-a8e4-5702916d22e4 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:31.062912 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ad917a22-269e-47ba-a8e4-5702916d22e4 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:31.063688 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ad917a22-269e-47ba-a8e4-5702916d22e4 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:31.064122 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ad917a22-269e-47ba-a8e4-5702916d22e4 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:31.134489 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-ad917a22-269e-47ba-a8e4-5702916d22e4 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action" status: 200 len: 23804 microversion: 2.20 time: 0.084372 Jan 18 16:35:31.135162 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 361/731] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:35:31 2022] POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action => generated 23804 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:35:32.146203 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-303b9725-3e3b-4a82-a735-169c91d07135 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:35:32.147201 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-303b9725-3e3b-4a82-a735-169c91d07135 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:32.155153 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-303b9725-3e3b-4a82-a735-169c91d07135 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:32.155598 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-303b9725-3e3b-4a82-a735-169c91d07135 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:32.156372 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-303b9725-3e3b-4a82-a735-169c91d07135 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:32.156834 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-303b9725-3e3b-4a82-a735-169c91d07135 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:32.230733 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-303b9725-3e3b-4a82-a735-169c91d07135 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action" status: 200 len: 25221 microversion: 2.20 time: 0.088444 Jan 18 16:35:32.231611 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 371/732] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:35:32 2022] POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action => generated 25221 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:35:33.244766 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-e84eef5c-824f-458c-beb6-fe6aef172589 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:35:33.245813 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-e84eef5c-824f-458c-beb6-fe6aef172589 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:33.252631 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e84eef5c-824f-458c-beb6-fe6aef172589 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:33.253111 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e84eef5c-824f-458c-beb6-fe6aef172589 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:33.253894 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e84eef5c-824f-458c-beb6-fe6aef172589 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:33.254328 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e84eef5c-824f-458c-beb6-fe6aef172589 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:33.341623 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-e84eef5c-824f-458c-beb6-fe6aef172589 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action" status: 200 len: 26722 microversion: 2.20 time: 0.101537 Jan 18 16:35:33.342206 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 362/733] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:35:33 2022] POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action => generated 26722 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:35:34.353987 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-70294ea5-40a0-44ee-9939-76edb85ca301 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:35:34.354987 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-70294ea5-40a0-44ee-9939-76edb85ca301 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:34.361885 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-70294ea5-40a0-44ee-9939-76edb85ca301 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:34.362346 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-70294ea5-40a0-44ee-9939-76edb85ca301 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:34.363128 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-70294ea5-40a0-44ee-9939-76edb85ca301 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:34.363561 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-70294ea5-40a0-44ee-9939-76edb85ca301 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:34.439559 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-70294ea5-40a0-44ee-9939-76edb85ca301 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action" status: 200 len: 27533 microversion: 2.20 time: 0.089646 Jan 18 16:35:34.440231 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 372/734] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:35:34 2022] POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action => generated 27533 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:35:35.451831 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-fcc7f586-3616-4625-87d1-f7fee91e2e8a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:35:35.452810 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-fcc7f586-3616-4625-87d1-f7fee91e2e8a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:35.459839 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-fcc7f586-3616-4625-87d1-f7fee91e2e8a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:35.460909 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-fcc7f586-3616-4625-87d1-f7fee91e2e8a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:35.461728 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-fcc7f586-3616-4625-87d1-f7fee91e2e8a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:35.462138 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-fcc7f586-3616-4625-87d1-f7fee91e2e8a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:35.466999 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-533ef8b1-16a5-4a3d-9ee0-e4cb7bff5136 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:35:35.467637 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-533ef8b1-16a5-4a3d-9ee0-e4cb7bff5136 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: 5b927087-6400-4a41-b19e-0e417905395e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:35.474792 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-533ef8b1-16a5-4a3d-9ee0-e4cb7bff5136 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:35.475245 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-533ef8b1-16a5-4a3d-9ee0-e4cb7bff5136 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:35.477668 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-533ef8b1-16a5-4a3d-9ee0-e4cb7bff5136 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:35.478223 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-533ef8b1-16a5-4a3d-9ee0-e4cb7bff5136 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:35.503337 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-533ef8b1-16a5-4a3d-9ee0-e4cb7bff5136 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: 5b927087-6400-4a41-b19e-0e417905395e] Going to try to terminate instance {{(pid=116367) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 18 16:35:35.548604 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-fcc7f586-3616-4625-87d1-f7fee91e2e8a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action" status: 200 len: 28029 microversion: 2.20 time: 0.100684 Jan 18 16:35:35.549682 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 363/735] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:35:35 2022] POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action => generated 28029 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:35:35.576540 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-533ef8b1-16a5-4a3d-9ee0-e4cb7bff5136 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "DELETE /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e" status: 204 len: 0 microversion: 2.1 time: 0.113431 Jan 18 16:35:35.577349 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 373/736] 10.222.0.82 () {58 vars in 1238 bytes} [Tue Jan 18 16:35:35 2022] DELETE /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 18 16:35:35.586882 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-6ae40ae3-3e9c-4284-bc7b-b064612872f8 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:35:35.587578 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-6ae40ae3-3e9c-4284-bc7b-b064612872f8 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: 5b927087-6400-4a41-b19e-0e417905395e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:35.594545 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-6ae40ae3-3e9c-4284-bc7b-b064612872f8 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:35.594996 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-6ae40ae3-3e9c-4284-bc7b-b064612872f8 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:35.595785 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-6ae40ae3-3e9c-4284-bc7b-b064612872f8 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:35.596220 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-6ae40ae3-3e9c-4284-bc7b-b064612872f8 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:35.734545 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-6ae40ae3-3e9c-4284-bc7b-b064612872f8 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:35.742217 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-6ae40ae3-3e9c-4284-bc7b-b064612872f8 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e" status: 200 len: 1577 microversion: 2.1 time: 0.160105 Jan 18 16:35:35.742776 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 364/737] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:35:35 2022] GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:35:36.561368 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-a9d8082d-c478-4508-9268-14eb7b8efc5e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:35:36.562366 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-a9d8082d-c478-4508-9268-14eb7b8efc5e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:36.569490 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a9d8082d-c478-4508-9268-14eb7b8efc5e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:36.569937 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a9d8082d-c478-4508-9268-14eb7b8efc5e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:36.570715 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a9d8082d-c478-4508-9268-14eb7b8efc5e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:36.571148 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a9d8082d-c478-4508-9268-14eb7b8efc5e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:36.649176 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-a9d8082d-c478-4508-9268-14eb7b8efc5e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action" status: 200 len: 28218 microversion: 2.20 time: 0.091664 Jan 18 16:35:36.649806 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 374/738] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:35:36 2022] POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action => generated 28218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 18 16:35:36.759439 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-e1fee298-aaaa-4280-a2e3-41996264d869 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:35:36.760016 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-e1fee298-aaaa-4280-a2e3-41996264d869 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: 5b927087-6400-4a41-b19e-0e417905395e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:36.766708 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e1fee298-aaaa-4280-a2e3-41996264d869 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:36.767157 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e1fee298-aaaa-4280-a2e3-41996264d869 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:36.767945 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e1fee298-aaaa-4280-a2e3-41996264d869 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:36.768382 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e1fee298-aaaa-4280-a2e3-41996264d869 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:36.898235 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-e1fee298-aaaa-4280-a2e3-41996264d869 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:36.905487 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-e1fee298-aaaa-4280-a2e3-41996264d869 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e" status: 200 len: 1577 microversion: 2.1 time: 0.149868 Jan 18 16:35:36.906051 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 365/739] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:35:36 2022] GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e => generated 1577 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:35:37.661241 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-b8252cd8-5075-4ac5-b9d3-f25b05016225 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:35:37.662232 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-b8252cd8-5075-4ac5-b9d3-f25b05016225 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:37.669688 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-b8252cd8-5075-4ac5-b9d3-f25b05016225 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:37.670129 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-b8252cd8-5075-4ac5-b9d3-f25b05016225 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:37.670920 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-b8252cd8-5075-4ac5-b9d3-f25b05016225 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:37.671642 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-b8252cd8-5075-4ac5-b9d3-f25b05016225 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:37.740271 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-b8252cd8-5075-4ac5-b9d3-f25b05016225 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action" status: 200 len: 28218 microversion: 2.20 time: 0.083151 Jan 18 16:35:37.741011 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 375/740] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:35:37 2022] POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action => generated 28218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:35:37.924027 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-b4683383-4e4b-4fe1-bb4c-0d2dcbe9b555 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:35:37.924666 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-b4683383-4e4b-4fe1-bb4c-0d2dcbe9b555 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: 5b927087-6400-4a41-b19e-0e417905395e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:37.932228 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-b4683383-4e4b-4fe1-bb4c-0d2dcbe9b555 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:37.932228 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-b4683383-4e4b-4fe1-bb4c-0d2dcbe9b555 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:37.933195 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-b4683383-4e4b-4fe1-bb4c-0d2dcbe9b555 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:37.933862 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-b4683383-4e4b-4fe1-bb4c-0d2dcbe9b555 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:38.011725 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-b4683383-4e4b-4fe1-bb4c-0d2dcbe9b555 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:38.019782 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-b4683383-4e4b-4fe1-bb4c-0d2dcbe9b555 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e" status: 200 len: 1509 microversion: 2.1 time: 0.099680 Jan 18 16:35:38.023345 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 366/741] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:35:37 2022] GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e => generated 1509 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:35:38.421662 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [req-55ccb024-e4e2-42b3-94f8-43b6b9160afe req-f7e0f555-75f4-4d2f-b56d-c96901ec2a9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b927087-6400-4a41-b19e-0e417905395e", "name": "network-vif-deleted", "tag": "0e5fd19d-7b69-41f6-849c-97ce9658dc29"}]} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:35:38.423170 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:35:38.423170 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: warnings.warn(msg) Jan 18 16:35:38.432247 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-55ccb024-e4e2-42b3-94f8-43b6b9160afe req-f7e0f555-75f4-4d2f-b56d-c96901ec2a9b service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:38.432692 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-55ccb024-e4e2-42b3-94f8-43b6b9160afe req-f7e0f555-75f4-4d2f-b56d-c96901ec2a9b service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:38.448260 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.compute.server_external_events [req-55ccb024-e4e2-42b3-94f8-43b6b9160afe req-f7e0f555-75f4-4d2f-b56d-c96901ec2a9b service nova] Creating event network-vif-deleted:0e5fd19d-7b69-41f6-849c-97ce9658dc29 for instance 5b927087-6400-4a41-b19e-0e417905395e on hv-cinder-78836 Jan 18 16:35:38.453574 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [req-55ccb024-e4e2-42b3-94f8-43b6b9160afe req-f7e0f555-75f4-4d2f-b56d-c96901ec2a9b service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170957 Jan 18 16:35:38.454350 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 376/742] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:35:38.751657 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-356507f4-e056-40e4-a9cf-a9dfca79c934 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:35:38.752559 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-356507f4-e056-40e4-a9cf-a9dfca79c934 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:38.759577 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-356507f4-e056-40e4-a9cf-a9dfca79c934 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:38.760082 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-356507f4-e056-40e4-a9cf-a9dfca79c934 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:38.760882 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-356507f4-e056-40e4-a9cf-a9dfca79c934 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:38.761345 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-356507f4-e056-40e4-a9cf-a9dfca79c934 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:38.838657 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-356507f4-e056-40e4-a9cf-a9dfca79c934 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action" status: 200 len: 28509 microversion: 2.20 time: 0.090618 Jan 18 16:35:38.842620 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 367/743] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:35:38 2022] POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action => generated 28509 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:35:39.037633 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-3d2344e4-2e51-40b8-a6f6-78a4b89a588e tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:35:39.038748 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-3d2344e4-2e51-40b8-a6f6-78a4b89a588e tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: 5b927087-6400-4a41-b19e-0e417905395e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:39.044849 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-3d2344e4-2e51-40b8-a6f6-78a4b89a588e tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:39.045325 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-3d2344e4-2e51-40b8-a6f6-78a4b89a588e tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:39.046393 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-3d2344e4-2e51-40b8-a6f6-78a4b89a588e tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:39.046393 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-3d2344e4-2e51-40b8-a6f6-78a4b89a588e tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:39.062482 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.wsgi [None req-3d2344e4-2e51-40b8-a6f6-78a4b89a588e tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] HTTP exception thrown: Instance 5b927087-6400-4a41-b19e-0e417905395e could not be found. Jan 18 16:35:39.063087 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-3d2344e4-2e51-40b8-a6f6-78a4b89a588e tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Returning 404 to user: Instance 5b927087-6400-4a41-b19e-0e417905395e could not be found. {{(pid=116367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 16:35:39.063916 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-3d2344e4-2e51-40b8-a6f6-78a4b89a588e tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e" status: 404 len: 111 microversion: 2.1 time: 0.030862 Jan 18 16:35:39.064466 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 377/744] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:35:39 2022] GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 16:35:39.160631 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-e8cce36d-627a-4d03-8d3d-cd132a3497e5 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1264872963", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-528604224", "security_groups": [{"name": "tempest-secgroup-smoke-2112687843"}], "block_device_mapping_v2": [{"uuid": "99f8d409-4548-4024-a716-0562d15f0fbf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1553074d-8be9-4ad2-b3ce-7b8026c06eda"}]}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:35:39.275208 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.network.neutron [None req-e8cce36d-627a-4d03-8d3d-cd132a3497e5 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] validate_networks() for [('1553074d-8be9-4ad2-b3ce-7b8026c06eda', None, None, None, None, None)] {{(pid=116368) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 18 16:35:39.707256 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-e8cce36d-627a-4d03-8d3d-cd132a3497e5 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Flavor limits 0:0:0 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 18 16:35:39.707707 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-e8cce36d-627a-4d03-8d3d-cd132a3497e5 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Image limits 0:0:0 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 18 16:35:39.708204 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-e8cce36d-627a-4d03-8d3d-cd132a3497e5 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Flavor pref 0:0:0 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 18 16:35:39.708646 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-e8cce36d-627a-4d03-8d3d-cd132a3497e5 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Image pref 0:0:0 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 18 16:35:39.709120 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-e8cce36d-627a-4d03-8d3d-cd132a3497e5 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 18 16:35:39.718324 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e8cce36d-627a-4d03-8d3d-cd132a3497e5 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:39.718781 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e8cce36d-627a-4d03-8d3d-cd132a3497e5 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:39.719625 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e8cce36d-627a-4d03-8d3d-cd132a3497e5 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:39.720059 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e8cce36d-627a-4d03-8d3d-cd132a3497e5 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:39.737323 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.quota [None req-e8cce36d-627a-4d03-8d3d-cd132a3497e5 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Getting quotas for project 89b9ac86cb4c4f109b49c6f9a66379a4. Resources: {'ram', 'instances', 'cores'} {{(pid=116368) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 16:35:39.741348 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.quota [None req-e8cce36d-627a-4d03-8d3d-cd132a3497e5 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Getting quotas for user 345686887fc3424fa518114e23f7fcc6 and project 89b9ac86cb4c4f109b49c6f9a66379a4. Resources: {'ram', 'instances', 'cores'} {{(pid=116368) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 16:35:39.796618 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-e8cce36d-627a-4d03-8d3d-cd132a3497e5 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Going to run 1 instances... {{(pid=116368) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 18 16:35:39.798835 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-e8cce36d-627a-4d03-8d3d-cd132a3497e5 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='99f8d409-4548-4024-a716-0562d15f0fbf',volume_size=None,volume_type=None)] {{(pid=116368) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 18 16:35:39.852140 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-caa06b4d-ce47-4903-9076-a2e26a367325 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:35:39.853079 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-caa06b4d-ce47-4903-9076-a2e26a367325 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:39.859208 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-caa06b4d-ce47-4903-9076-a2e26a367325 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:39.859661 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-caa06b4d-ce47-4903-9076-a2e26a367325 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:39.860446 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-caa06b4d-ce47-4903-9076-a2e26a367325 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:39.860882 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-caa06b4d-ce47-4903-9076-a2e26a367325 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:39.919348 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-e8cce36d-627a-4d03-8d3d-cd132a3497e5 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.762738 Jan 18 16:35:39.920003 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 368/745] 10.222.0.82 () {60 vars in 1146 bytes} [Tue Jan 18 16:35:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 18 16:35:39.929909 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-b4cadb97-b8c7-44e5-b07c-907130c09791 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:35:39.930509 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-b4cadb97-b8c7-44e5-b07c-907130c09791 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:39.944964 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-caa06b4d-ce47-4903-9076-a2e26a367325 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action" status: 200 len: 28677 microversion: 2.20 time: 0.097783 Jan 18 16:35:39.948862 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 378/746] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:35:39 2022] POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action => generated 28677 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:35:39.982019 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-b4cadb97-b8c7-44e5-b07c-907130c09791 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:39.989255 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-b4cadb97-b8c7-44e5-b07c-907130c09791 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987" status: 200 len: 1094 microversion: 2.1 time: 0.063298 Jan 18 16:35:39.990241 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 369/747] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:35:39 2022] GET /compute/v2.1/servers/a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987 => generated 1094 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:35:40.956004 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-c64b89d3-2822-4f41-88e3-9ddff9e1b331 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:35:40.957178 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-c64b89d3-2822-4f41-88e3-9ddff9e1b331 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:40.965233 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c64b89d3-2822-4f41-88e3-9ddff9e1b331 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:40.966170 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c64b89d3-2822-4f41-88e3-9ddff9e1b331 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:40.966954 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c64b89d3-2822-4f41-88e3-9ddff9e1b331 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:40.967383 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c64b89d3-2822-4f41-88e3-9ddff9e1b331 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:41.006247 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-3be39e37-7a57-4bf9-9d8b-ad47878e40b9 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:35:41.006940 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-3be39e37-7a57-4bf9-9d8b-ad47878e40b9 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:41.014592 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3be39e37-7a57-4bf9-9d8b-ad47878e40b9 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:41.015117 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3be39e37-7a57-4bf9-9d8b-ad47878e40b9 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:41.016107 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3be39e37-7a57-4bf9-9d8b-ad47878e40b9 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:41.016498 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3be39e37-7a57-4bf9-9d8b-ad47878e40b9 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:41.036578 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-c64b89d3-2822-4f41-88e3-9ddff9e1b331 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action" status: 200 len: 28677 microversion: 2.20 time: 0.084421 Jan 18 16:35:41.040965 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 379/748] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:35:40 2022] POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action => generated 28677 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:35:41.093766 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-3be39e37-7a57-4bf9-9d8b-ad47878e40b9 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:41.101531 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-3be39e37-7a57-4bf9-9d8b-ad47878e40b9 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987" status: 200 len: 1210 microversion: 2.1 time: 0.099014 Jan 18 16:35:41.102114 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 370/749] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:35:41 2022] GET /compute/v2.1/servers/a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987 => generated 1210 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:35:42.049768 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-c766b6a1-ab1d-405f-be47-29d93300e9bb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:35:42.050784 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-c766b6a1-ab1d-405f-be47-29d93300e9bb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:42.059417 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c766b6a1-ab1d-405f-be47-29d93300e9bb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:42.059866 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c766b6a1-ab1d-405f-be47-29d93300e9bb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:42.060665 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c766b6a1-ab1d-405f-be47-29d93300e9bb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:42.061161 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c766b6a1-ab1d-405f-be47-29d93300e9bb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:42.118462 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-0798c000-af8b-4f69-9dcd-919b3755ca7e tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:35:42.119632 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-0798c000-af8b-4f69-9dcd-919b3755ca7e tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:42.126880 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0798c000-af8b-4f69-9dcd-919b3755ca7e tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:42.127938 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0798c000-af8b-4f69-9dcd-919b3755ca7e tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:42.129710 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0798c000-af8b-4f69-9dcd-919b3755ca7e tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:42.130702 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0798c000-af8b-4f69-9dcd-919b3755ca7e tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:42.144897 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-c766b6a1-ab1d-405f-be47-29d93300e9bb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action" status: 200 len: 28677 microversion: 2.20 time: 0.098339 Jan 18 16:35:42.147813 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 380/750] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:35:42 2022] POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action => generated 28677 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:35:42.276824 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [req-7a16a15d-5f47-452e-8223-c7ef0900c7a4 req-9fa80e2c-fab4-47d5-91aa-f1947dc2f4ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987", "tag": "3db787b2-9f3f-4ce3-98a8-15e5146e27d0"}]} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:35:42.279845 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:35:42.279845 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: warnings.warn(msg) Jan 18 16:35:42.301396 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-7a16a15d-5f47-452e-8223-c7ef0900c7a4 req-9fa80e2c-fab4-47d5-91aa-f1947dc2f4ee service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:42.301843 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-7a16a15d-5f47-452e-8223-c7ef0900c7a4 req-9fa80e2c-fab4-47d5-91aa-f1947dc2f4ee service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:42.314293 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.compute.server_external_events [req-7a16a15d-5f47-452e-8223-c7ef0900c7a4 req-9fa80e2c-fab4-47d5-91aa-f1947dc2f4ee service nova] Creating event network-changed:3db787b2-9f3f-4ce3-98a8-15e5146e27d0 for instance a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987 on hv-cinder-78836 Jan 18 16:35:42.320069 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [req-7a16a15d-5f47-452e-8223-c7ef0900c7a4 req-9fa80e2c-fab4-47d5-91aa-f1947dc2f4ee service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051051 Jan 18 16:35:42.321393 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 381/751] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:35:42.388161 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-0798c000-af8b-4f69-9dcd-919b3755ca7e tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:42.397205 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-0798c000-af8b-4f69-9dcd-919b3755ca7e tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987" status: 200 len: 1266 microversion: 2.1 time: 0.282458 Jan 18 16:35:42.408355 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 371/752] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:35:42 2022] GET /compute/v2.1/servers/a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987 => generated 1266 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:35:43.157873 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-5ba4f18b-5a15-437f-8462-cd48463101cc tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:35:43.159016 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-5ba4f18b-5a15-437f-8462-cd48463101cc tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:43.166577 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-5ba4f18b-5a15-437f-8462-cd48463101cc tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:43.167021 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-5ba4f18b-5a15-437f-8462-cd48463101cc tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:43.167820 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-5ba4f18b-5a15-437f-8462-cd48463101cc tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:43.168251 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-5ba4f18b-5a15-437f-8462-cd48463101cc tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:43.230864 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-5ba4f18b-5a15-437f-8462-cd48463101cc tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action" status: 200 len: 28677 microversion: 2.20 time: 0.076812 Jan 18 16:35:43.231518 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 382/753] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:35:43 2022] POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action => generated 28677 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:35:43.415745 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-49655fca-5645-419e-9310-a6b926219ae3 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:35:43.416345 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-49655fca-5645-419e-9310-a6b926219ae3 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:43.422710 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-49655fca-5645-419e-9310-a6b926219ae3 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:43.423160 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-49655fca-5645-419e-9310-a6b926219ae3 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:43.423939 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-49655fca-5645-419e-9310-a6b926219ae3 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:43.424373 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-49655fca-5645-419e-9310-a6b926219ae3 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:43.568891 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-49655fca-5645-419e-9310-a6b926219ae3 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:43.576892 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-49655fca-5645-419e-9310-a6b926219ae3 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987" status: 200 len: 1266 microversion: 2.1 time: 0.165591 Jan 18 16:35:43.577482 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 372/754] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:35:43 2022] GET /compute/v2.1/servers/a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:35:44.243635 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-e07382b5-abc2-4be5-8616-7dcbf30e7802 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:35:44.244635 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-e07382b5-abc2-4be5-8616-7dcbf30e7802 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:44.251529 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e07382b5-abc2-4be5-8616-7dcbf30e7802 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:44.251976 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e07382b5-abc2-4be5-8616-7dcbf30e7802 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:44.252759 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e07382b5-abc2-4be5-8616-7dcbf30e7802 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:44.253224 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e07382b5-abc2-4be5-8616-7dcbf30e7802 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:44.324758 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-e07382b5-abc2-4be5-8616-7dcbf30e7802 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action" status: 200 len: 30250 microversion: 2.20 time: 0.085595 Jan 18 16:35:44.325408 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 383/755] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:35:44 2022] POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action => generated 30250 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:35:44.594093 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-e482e767-3ea6-40fd-a8f2-9836c11770cc tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:35:44.594672 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-e482e767-3ea6-40fd-a8f2-9836c11770cc tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:44.601546 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e482e767-3ea6-40fd-a8f2-9836c11770cc tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:44.601983 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e482e767-3ea6-40fd-a8f2-9836c11770cc tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:44.602751 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e482e767-3ea6-40fd-a8f2-9836c11770cc tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:44.603177 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e482e767-3ea6-40fd-a8f2-9836c11770cc tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:44.731368 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-e482e767-3ea6-40fd-a8f2-9836c11770cc tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:44.738558 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-e482e767-3ea6-40fd-a8f2-9836c11770cc tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987" status: 200 len: 1266 microversion: 2.1 time: 0.148170 Jan 18 16:35:44.739117 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 373/756] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:35:44 2022] GET /compute/v2.1/servers/a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:35:45.338119 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-9afb18c9-d28c-403f-bb33-c2bbcded0304 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:35:45.339112 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-9afb18c9-d28c-403f-bb33-c2bbcded0304 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:45.345923 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-9afb18c9-d28c-403f-bb33-c2bbcded0304 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:45.346399 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-9afb18c9-d28c-403f-bb33-c2bbcded0304 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:45.347180 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-9afb18c9-d28c-403f-bb33-c2bbcded0304 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:45.347622 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-9afb18c9-d28c-403f-bb33-c2bbcded0304 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:45.420279 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-9afb18c9-d28c-403f-bb33-c2bbcded0304 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action" status: 200 len: 32320 microversion: 2.20 time: 0.086701 Jan 18 16:35:45.421888 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 384/757] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:35:45 2022] POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action => generated 32320 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:35:45.755357 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-ebd35c65-bcec-4ce0-b0fa-0e1c35099a0d tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:35:45.756011 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-ebd35c65-bcec-4ce0-b0fa-0e1c35099a0d tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:45.762912 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ebd35c65-bcec-4ce0-b0fa-0e1c35099a0d tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:45.763363 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ebd35c65-bcec-4ce0-b0fa-0e1c35099a0d tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:45.764143 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ebd35c65-bcec-4ce0-b0fa-0e1c35099a0d tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:45.764579 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ebd35c65-bcec-4ce0-b0fa-0e1c35099a0d tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:45.900045 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-ebd35c65-bcec-4ce0-b0fa-0e1c35099a0d tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:45.907282 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-ebd35c65-bcec-4ce0-b0fa-0e1c35099a0d tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987" status: 200 len: 1266 microversion: 2.1 time: 0.155570 Jan 18 16:35:45.907830 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 374/758] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:35:45 2022] GET /compute/v2.1/servers/a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:35:46.433248 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-632c675b-ce51-4dbc-9e4d-532d0d7294c4 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:35:46.434237 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-632c675b-ce51-4dbc-9e4d-532d0d7294c4 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:46.440597 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-632c675b-ce51-4dbc-9e4d-532d0d7294c4 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:46.441337 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-632c675b-ce51-4dbc-9e4d-532d0d7294c4 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:46.442118 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-632c675b-ce51-4dbc-9e4d-532d0d7294c4 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:46.442551 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-632c675b-ce51-4dbc-9e4d-532d0d7294c4 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:46.516730 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-632c675b-ce51-4dbc-9e4d-532d0d7294c4 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action" status: 200 len: 33396 microversion: 2.20 time: 0.088087 Jan 18 16:35:46.517407 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 385/759] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:35:46 2022] POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action => generated 33396 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:35:46.923436 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-0f6f0098-2a3e-46b4-9163-1ae7ce1d426f tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:35:46.924034 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-0f6f0098-2a3e-46b4-9163-1ae7ce1d426f tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:46.930452 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0f6f0098-2a3e-46b4-9163-1ae7ce1d426f tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:46.930895 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0f6f0098-2a3e-46b4-9163-1ae7ce1d426f tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:46.931671 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0f6f0098-2a3e-46b4-9163-1ae7ce1d426f tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:46.932157 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0f6f0098-2a3e-46b4-9163-1ae7ce1d426f tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:47.061947 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-0f6f0098-2a3e-46b4-9163-1ae7ce1d426f tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:47.069975 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-0f6f0098-2a3e-46b4-9163-1ae7ce1d426f tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987" status: 200 len: 1266 microversion: 2.1 time: 0.149576 Jan 18 16:35:47.070427 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 375/760] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:35:46 2022] GET /compute/v2.1/servers/a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:35:47.529076 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-5fe93950-ebb0-4cdd-8226-33df287bb0a0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:35:47.529962 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-5fe93950-ebb0-4cdd-8226-33df287bb0a0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:47.536762 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-5fe93950-ebb0-4cdd-8226-33df287bb0a0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:47.537293 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-5fe93950-ebb0-4cdd-8226-33df287bb0a0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:47.538603 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-5fe93950-ebb0-4cdd-8226-33df287bb0a0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:47.539043 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-5fe93950-ebb0-4cdd-8226-33df287bb0a0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:47.611155 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-5fe93950-ebb0-4cdd-8226-33df287bb0a0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action" status: 200 len: 34538 microversion: 2.20 time: 0.086119 Jan 18 16:35:47.611786 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 386/761] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:35:47 2022] POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action => generated 34538 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:35:48.086791 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-4eee8f79-d9b5-4bcd-b818-8360c7fceb80 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:35:48.087476 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-4eee8f79-d9b5-4bcd-b818-8360c7fceb80 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:48.093887 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4eee8f79-d9b5-4bcd-b818-8360c7fceb80 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:48.094340 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4eee8f79-d9b5-4bcd-b818-8360c7fceb80 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:48.095208 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4eee8f79-d9b5-4bcd-b818-8360c7fceb80 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:48.095650 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4eee8f79-d9b5-4bcd-b818-8360c7fceb80 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:48.240267 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-4eee8f79-d9b5-4bcd-b818-8360c7fceb80 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:48.247664 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-4eee8f79-d9b5-4bcd-b818-8360c7fceb80 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987" status: 200 len: 1266 microversion: 2.1 time: 0.165087 Jan 18 16:35:48.248224 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 376/762] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:35:48 2022] GET /compute/v2.1/servers/a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:35:48.279914 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-96594c2b-0160-4c2d-916d-1307dd92440d tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1570491636"}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:35:48.280543 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-96594c2b-0160-4c2d-916d-1307dd92440d tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:48.287372 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-96594c2b-0160-4c2d-916d-1307dd92440d tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:48.288535 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-96594c2b-0160-4c2d-916d-1307dd92440d tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:48.289434 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-96594c2b-0160-4c2d-916d-1307dd92440d tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:48.289879 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-96594c2b-0160-4c2d-916d-1307dd92440d tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:48.419970 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.network.security_group_api [None req-96594c2b-0160-4c2d-916d-1307dd92440d tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Removing security group f9dc9be4-c094-4811-bf84-edfcc03687aa from port 684a69e2-8aee-429a-ad20-cba1e94ddb16 Jan 18 16:35:48.622741 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-ab735f19-c484-4b56-96d2-92888c7722fe tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:35:48.623614 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-ab735f19-c484-4b56-96d2-92888c7722fe tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:48.629679 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ab735f19-c484-4b56-96d2-92888c7722fe tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:48.630120 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ab735f19-c484-4b56-96d2-92888c7722fe tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:48.630889 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ab735f19-c484-4b56-96d2-92888c7722fe tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:48.631944 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ab735f19-c484-4b56-96d2-92888c7722fe tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:48.709259 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-ab735f19-c484-4b56-96d2-92888c7722fe tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action" status: 200 len: 35577 microversion: 2.20 time: 0.090062 Jan 18 16:35:48.711042 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 377/763] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:35:48 2022] POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action => generated 35577 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 18 16:35:48.775610 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-96594c2b-0160-4c2d-916d-1307dd92440d tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "POST /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6/action" status: 202 len: 0 microversion: 2.1 time: 0.499718 Jan 18 16:35:48.783916 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [req-e18dc006-a411-46c8-b2a3-76f04f6a7890 req-dc82bf01-8230-44ca-8af6-c071479729ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "218c4c12-4e16-4dc9-8519-bcef764f01c6", "tag": "684a69e2-8aee-429a-ad20-cba1e94ddb16"}]} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:35:48.785551 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:35:48.785551 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: warnings.warn(msg) Jan 18 16:35:48.785963 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 387/764] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:35:48 2022] POST /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6/action => generated 0 bytes in 511 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:35:48.798696 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-e18dc006-a411-46c8-b2a3-76f04f6a7890 req-dc82bf01-8230-44ca-8af6-c071479729ee service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:48.799138 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-e18dc006-a411-46c8-b2a3-76f04f6a7890 req-dc82bf01-8230-44ca-8af6-c071479729ee service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:48.822921 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.compute.server_external_events [req-e18dc006-a411-46c8-b2a3-76f04f6a7890 req-dc82bf01-8230-44ca-8af6-c071479729ee service nova] Creating event network-changed:684a69e2-8aee-429a-ad20-cba1e94ddb16 for instance 218c4c12-4e16-4dc9-8519-bcef764f01c6 on hv-cinder-78836 Jan 18 16:35:48.828355 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [req-e18dc006-a411-46c8-b2a3-76f04f6a7890 req-dc82bf01-8230-44ca-8af6-c071479729ee service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048359 Jan 18 16:35:48.830249 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 378/765] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:35:49.264452 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-6cd9b106-99ef-4a69-a7af-6efdd53b22ff tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:35:49.265092 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-6cd9b106-99ef-4a69-a7af-6efdd53b22ff tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:49.271030 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6cd9b106-99ef-4a69-a7af-6efdd53b22ff tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:49.271465 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6cd9b106-99ef-4a69-a7af-6efdd53b22ff tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:49.273224 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6cd9b106-99ef-4a69-a7af-6efdd53b22ff tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:49.273839 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6cd9b106-99ef-4a69-a7af-6efdd53b22ff tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:49.489313 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-6cd9b106-99ef-4a69-a7af-6efdd53b22ff tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:49.497752 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-6cd9b106-99ef-4a69-a7af-6efdd53b22ff tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987" status: 200 len: 1266 microversion: 2.1 time: 0.237270 Jan 18 16:35:49.498351 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 388/766] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:35:49 2022] GET /compute/v2.1/servers/a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987 => generated 1266 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:35:49.722408 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-04bdf8e7-40ef-41f0-8d55-19d0279211be tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:35:49.723415 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-04bdf8e7-40ef-41f0-8d55-19d0279211be tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:49.730346 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-04bdf8e7-40ef-41f0-8d55-19d0279211be tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:49.730785 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-04bdf8e7-40ef-41f0-8d55-19d0279211be tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:49.731560 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-04bdf8e7-40ef-41f0-8d55-19d0279211be tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:49.731990 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-04bdf8e7-40ef-41f0-8d55-19d0279211be tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:49.801910 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-04bdf8e7-40ef-41f0-8d55-19d0279211be tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action" status: 200 len: 37080 microversion: 2.20 time: 0.083783 Jan 18 16:35:49.804974 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 379/767] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:35:49 2022] POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action => generated 37080 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:35:50.128597 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-db6c13de-0edb-4a7a-a753-2f2f0b60a378 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:35:50.129712 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-db6c13de-0edb-4a7a-a753-2f2f0b60a378 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:50.143059 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-db6c13de-0edb-4a7a-a753-2f2f0b60a378 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:50.143436 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-db6c13de-0edb-4a7a-a753-2f2f0b60a378 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:50.144229 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-db6c13de-0edb-4a7a-a753-2f2f0b60a378 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:50.144657 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-db6c13de-0edb-4a7a-a753-2f2f0b60a378 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:50.203493 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [req-ac3bf99d-1d41-4dbe-bf9a-0eab1d0af636 req-7d874d12-1466-4cb4-9697-e7a79cfd2b38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "218c4c12-4e16-4dc9-8519-bcef764f01c6", "tag": "684a69e2-8aee-429a-ad20-cba1e94ddb16"}]} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:35:50.204988 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:35:50.204988 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: warnings.warn(msg) Jan 18 16:35:50.213673 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-ac3bf99d-1d41-4dbe-bf9a-0eab1d0af636 req-7d874d12-1466-4cb4-9697-e7a79cfd2b38 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:50.214109 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-ac3bf99d-1d41-4dbe-bf9a-0eab1d0af636 req-7d874d12-1466-4cb4-9697-e7a79cfd2b38 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:50.224313 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.compute.server_external_events [req-ac3bf99d-1d41-4dbe-bf9a-0eab1d0af636 req-7d874d12-1466-4cb4-9697-e7a79cfd2b38 service nova] Creating event network-changed:684a69e2-8aee-429a-ad20-cba1e94ddb16 for instance 218c4c12-4e16-4dc9-8519-bcef764f01c6 on hv-cinder-78836 Jan 18 16:35:50.230410 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [req-ac3bf99d-1d41-4dbe-bf9a-0eab1d0af636 req-7d874d12-1466-4cb4-9697-e7a79cfd2b38 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103387 Jan 18 16:35:50.231191 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 380/768] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 16:35:50.249986 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.objects.instance [None req-db6c13de-0edb-4a7a-a753-2f2f0b60a378 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lazy-loading 'services' on Instance uuid 218c4c12-4e16-4dc9-8519-bcef764f01c6 {{(pid=116367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 18 16:35:50.324184 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-db6c13de-0edb-4a7a-a753-2f2f0b60a378 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "DELETE /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6/os-volume_attachments/61bfb964-aa2a-4025-a27c-b45927b538bb" status: 202 len: 0 microversion: 2.1 time: 0.199631 Jan 18 16:35:50.325115 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 389/769] 10.222.0.82 () {58 vars in 1415 bytes} [Tue Jan 18 16:35:50 2022] DELETE /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6/os-volume_attachments/61bfb964-aa2a-4025-a27c-b45927b538bb => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:35:50.335275 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-19ff9f81-f9fa-4175-86f6-a51d9cf88376 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:35:50.337333 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-19ff9f81-f9fa-4175-86f6-a51d9cf88376 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:50.344705 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-19ff9f81-f9fa-4175-86f6-a51d9cf88376 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:50.345395 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-19ff9f81-f9fa-4175-86f6-a51d9cf88376 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:50.346412 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-19ff9f81-f9fa-4175-86f6-a51d9cf88376 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:50.347729 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-19ff9f81-f9fa-4175-86f6-a51d9cf88376 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:50.386060 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-19ff9f81-f9fa-4175-86f6-a51d9cf88376 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055901 Jan 18 16:35:50.386710 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 381/770] 10.222.0.82 () {58 vars in 1301 bytes} [Tue Jan 18 16:35:50 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 16:35:50.515186 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-5ec9d569-fae5-4c5c-b3d3-859f8e1b7031 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:35:50.516240 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-5ec9d569-fae5-4c5c-b3d3-859f8e1b7031 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:50.523383 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-5ec9d569-fae5-4c5c-b3d3-859f8e1b7031 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:50.523884 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-5ec9d569-fae5-4c5c-b3d3-859f8e1b7031 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:50.524870 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-5ec9d569-fae5-4c5c-b3d3-859f8e1b7031 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:50.525273 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-5ec9d569-fae5-4c5c-b3d3-859f8e1b7031 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:50.775694 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-5ec9d569-fae5-4c5c-b3d3-859f8e1b7031 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:50.784310 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-5ec9d569-fae5-4c5c-b3d3-859f8e1b7031 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987" status: 200 len: 1266 microversion: 2.1 time: 0.273659 Jan 18 16:35:50.794652 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 390/771] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:35:50 2022] GET /compute/v2.1/servers/a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987 => generated 1266 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:35:50.815092 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-0ef4b632-656e-442f-8d9d-9c62dfea75b5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:35:50.816350 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-0ef4b632-656e-442f-8d9d-9c62dfea75b5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:50.823217 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0ef4b632-656e-442f-8d9d-9c62dfea75b5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:50.823953 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0ef4b632-656e-442f-8d9d-9c62dfea75b5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:50.824804 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0ef4b632-656e-442f-8d9d-9c62dfea75b5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:50.825475 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0ef4b632-656e-442f-8d9d-9c62dfea75b5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:50.906153 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-0ef4b632-656e-442f-8d9d-9c62dfea75b5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action" status: 200 len: 38234 microversion: 2.20 time: 0.095145 Jan 18 16:35:50.911105 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 382/772] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:35:50 2022] POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action => generated 38234 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:35:51.397882 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-2c6f6bad-7d7d-4c22-bcb1-f4596bc139d5 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:35:51.398862 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-2c6f6bad-7d7d-4c22-bcb1-f4596bc139d5 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:51.405248 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2c6f6bad-7d7d-4c22-bcb1-f4596bc139d5 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:51.405694 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2c6f6bad-7d7d-4c22-bcb1-f4596bc139d5 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:51.406462 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2c6f6bad-7d7d-4c22-bcb1-f4596bc139d5 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:51.406892 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2c6f6bad-7d7d-4c22-bcb1-f4596bc139d5 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:51.435637 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-2c6f6bad-7d7d-4c22-bcb1-f4596bc139d5 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041680 Jan 18 16:35:51.436193 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 391/773] 10.222.0.82 () {58 vars in 1301 bytes} [Tue Jan 18 16:35:51 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 18 16:35:51.446983 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-ef29cb05-c3da-433c-b341-15442c395c39 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:35:51.447603 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-ef29cb05-c3da-433c-b341-15442c395c39 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:51.454785 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ef29cb05-c3da-433c-b341-15442c395c39 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:51.455267 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ef29cb05-c3da-433c-b341-15442c395c39 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:51.456098 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ef29cb05-c3da-433c-b341-15442c395c39 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:51.456558 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ef29cb05-c3da-433c-b341-15442c395c39 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:51.529817 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.wsgi [None req-ef29cb05-c3da-433c-b341-15442c395c39 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] HTTP exception thrown: Instance 218c4c12-4e16-4dc9-8519-bcef764f01c6 is not attached to volume 61bfb964-aa2a-4025-a27c-b45927b538bb Jan 18 16:35:51.530410 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-ef29cb05-c3da-433c-b341-15442c395c39 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Returning 404 to user: Instance 218c4c12-4e16-4dc9-8519-bcef764f01c6 is not attached to volume 61bfb964-aa2a-4025-a27c-b45927b538bb {{(pid=116368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 16:35:51.531240 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-ef29cb05-c3da-433c-b341-15442c395c39 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "DELETE /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6/os-volume_attachments/61bfb964-aa2a-4025-a27c-b45927b538bb" status: 404 len: 154 microversion: 2.1 time: 0.088941 Jan 18 16:35:51.531798 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 383/774] 10.222.0.82 () {58 vars in 1415 bytes} [Tue Jan 18 16:35:51 2022] DELETE /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6/os-volume_attachments/61bfb964-aa2a-4025-a27c-b45927b538bb => generated 154 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 16:35:51.801612 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-2e1d71a5-1bce-4118-8e0d-28de243743d8 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:35:51.802222 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-2e1d71a5-1bce-4118-8e0d-28de243743d8 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:51.808321 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2e1d71a5-1bce-4118-8e0d-28de243743d8 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:51.808772 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2e1d71a5-1bce-4118-8e0d-28de243743d8 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:51.809597 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2e1d71a5-1bce-4118-8e0d-28de243743d8 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:51.810094 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2e1d71a5-1bce-4118-8e0d-28de243743d8 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:51.918420 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-9d7f3bc3-d7f6-4932-a9e6-4b0c7932e3f0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:35:51.919396 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-9d7f3bc3-d7f6-4932-a9e6-4b0c7932e3f0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:51.926302 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-9d7f3bc3-d7f6-4932-a9e6-4b0c7932e3f0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:51.926754 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-9d7f3bc3-d7f6-4932-a9e6-4b0c7932e3f0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:51.927537 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-9d7f3bc3-d7f6-4932-a9e6-4b0c7932e3f0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:51.927978 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-9d7f3bc3-d7f6-4932-a9e6-4b0c7932e3f0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:51.950240 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-2e1d71a5-1bce-4118-8e0d-28de243743d8 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:51.957768 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-2e1d71a5-1bce-4118-8e0d-28de243743d8 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987" status: 200 len: 1266 microversion: 2.1 time: 0.159746 Jan 18 16:35:51.958339 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 392/775] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:35:51 2022] GET /compute/v2.1/servers/a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:35:51.996941 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-9d7f3bc3-d7f6-4932-a9e6-4b0c7932e3f0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action" status: 200 len: 38234 microversion: 2.20 time: 0.082046 Jan 18 16:35:51.997597 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 384/776] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:35:51 2022] POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action => generated 38234 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 18 16:35:52.664731 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-6d5255f3-5ae8-419f-b6b8-a3a8a25f22ae tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:35:52.665294 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-6d5255f3-5ae8-419f-b6b8-a3a8a25f22ae tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:52.671894 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6d5255f3-5ae8-419f-b6b8-a3a8a25f22ae tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:52.672357 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6d5255f3-5ae8-419f-b6b8-a3a8a25f22ae tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:52.673312 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6d5255f3-5ae8-419f-b6b8-a3a8a25f22ae tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:52.673833 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6d5255f3-5ae8-419f-b6b8-a3a8a25f22ae tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:52.699940 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-6d5255f3-5ae8-419f-b6b8-a3a8a25f22ae tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Going to try to terminate instance {{(pid=116367) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 18 16:35:52.924767 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-6d5255f3-5ae8-419f-b6b8-a3a8a25f22ae tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "DELETE /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 204 len: 0 microversion: 2.1 time: 0.263681 Jan 18 16:35:52.925385 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 393/777] 10.222.0.82 () {58 vars in 1238 bytes} [Tue Jan 18 16:35:52 2022] DELETE /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 18 16:35:52.934649 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-4e57f15e-9dbd-43f5-bc6a-f6fe4f8b4fcb tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:35:52.935465 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-4e57f15e-9dbd-43f5-bc6a-f6fe4f8b4fcb tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:52.942505 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4e57f15e-9dbd-43f5-bc6a-f6fe4f8b4fcb tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:52.942949 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4e57f15e-9dbd-43f5-bc6a-f6fe4f8b4fcb tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:52.943723 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4e57f15e-9dbd-43f5-bc6a-f6fe4f8b4fcb tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:52.944165 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4e57f15e-9dbd-43f5-bc6a-f6fe4f8b4fcb tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:52.974501 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-a86d9a09-1900-4689-bf33-d75d4d7fa48a tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:35:52.975184 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-a86d9a09-1900-4689-bf33-d75d4d7fa48a tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:52.981151 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a86d9a09-1900-4689-bf33-d75d4d7fa48a tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:52.981589 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a86d9a09-1900-4689-bf33-d75d4d7fa48a tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:52.982388 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a86d9a09-1900-4689-bf33-d75d4d7fa48a tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:52.982779 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a86d9a09-1900-4689-bf33-d75d4d7fa48a tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:53.126739 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-4e57f15e-9dbd-43f5-bc6a-f6fe4f8b4fcb tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0509d42df8844400b99d7c060ab98c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:53.135724 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-4e57f15e-9dbd-43f5-bc6a-f6fe4f8b4fcb tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 200 len: 1554 microversion: 2.1 time: 0.205168 Jan 18 16:35:53.136534 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 385/778] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:35:52 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 1554 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:35:53.151111 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-1c18b3a4-0f7d-4362-bf54-f17a1ac20a41 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:35:53.152275 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-1c18b3a4-0f7d-4362-bf54-f17a1ac20a41 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:53.157950 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1c18b3a4-0f7d-4362-bf54-f17a1ac20a41 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:53.158395 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1c18b3a4-0f7d-4362-bf54-f17a1ac20a41 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:53.159180 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1c18b3a4-0f7d-4362-bf54-f17a1ac20a41 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:53.159609 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1c18b3a4-0f7d-4362-bf54-f17a1ac20a41 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:53.182304 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-a86d9a09-1900-4689-bf33-d75d4d7fa48a tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:53.190393 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-a86d9a09-1900-4689-bf33-d75d4d7fa48a tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987" status: 200 len: 1266 microversion: 2.1 time: 0.219857 Jan 18 16:35:53.191308 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 394/779] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:35:52 2022] GET /compute/v2.1/servers/a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987 => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:35:53.223933 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-1c18b3a4-0f7d-4362-bf54-f17a1ac20a41 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action" status: 200 len: 38234 microversion: 2.20 time: 0.076937 Jan 18 16:35:53.228263 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 386/780] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:35:53 2022] POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action => generated 38234 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:35:53.298913 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [req-c8a2e4bc-c0f8-41e3-8410-52f671ba89fb req-20261142-5b48-4557-a83c-9886e4efacab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987", "name": "network-vif-plugged", "status": "completed", "tag": "3db787b2-9f3f-4ce3-98a8-15e5146e27d0"}]} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:35:53.300441 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:35:53.300441 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: warnings.warn(msg) Jan 18 16:35:53.307805 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-c8a2e4bc-c0f8-41e3-8410-52f671ba89fb req-20261142-5b48-4557-a83c-9886e4efacab service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:53.308243 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-c8a2e4bc-c0f8-41e3-8410-52f671ba89fb req-20261142-5b48-4557-a83c-9886e4efacab service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:53.318874 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.compute.server_external_events [req-c8a2e4bc-c0f8-41e3-8410-52f671ba89fb req-20261142-5b48-4557-a83c-9886e4efacab service nova] Creating event network-vif-plugged:3db787b2-9f3f-4ce3-98a8-15e5146e27d0 for instance a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987 on hv-cinder-78836 Jan 18 16:35:53.324419 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [req-c8a2e4bc-c0f8-41e3-8410-52f671ba89fb req-20261142-5b48-4557-a83c-9886e4efacab service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086447 Jan 18 16:35:53.325111 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 395/781] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:35:54.153607 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-2308cda2-d862-4cbd-8109-844bd7bf2d5b tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:35:54.154394 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-2308cda2-d862-4cbd-8109-844bd7bf2d5b tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:54.161258 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-2308cda2-d862-4cbd-8109-844bd7bf2d5b tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:54.161710 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-2308cda2-d862-4cbd-8109-844bd7bf2d5b tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:54.162495 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-2308cda2-d862-4cbd-8109-844bd7bf2d5b tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:54.162933 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-2308cda2-d862-4cbd-8109-844bd7bf2d5b tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:54.209455 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-faf12547-7eff-478d-b99f-2fb09e0f1d36 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:35:54.210294 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-faf12547-7eff-478d-b99f-2fb09e0f1d36 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:54.216204 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-faf12547-7eff-478d-b99f-2fb09e0f1d36 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:54.216644 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-faf12547-7eff-478d-b99f-2fb09e0f1d36 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:54.217433 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-faf12547-7eff-478d-b99f-2fb09e0f1d36 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:54.217860 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-faf12547-7eff-478d-b99f-2fb09e0f1d36 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:54.338578 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-2308cda2-d862-4cbd-8109-844bd7bf2d5b tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0509d42df8844400b99d7c060ab98c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:54.346150 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-2308cda2-d862-4cbd-8109-844bd7bf2d5b tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 200 len: 1554 microversion: 2.1 time: 0.196515 Jan 18 16:35:54.346723 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 387/782] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:35:54 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 1554 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:35:54.356232 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-72debd01-8305-4770-ac82-dc2dd20f7d84 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:35:54.356232 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-72debd01-8305-4770-ac82-dc2dd20f7d84 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:54.358309 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-72debd01-8305-4770-ac82-dc2dd20f7d84 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:54.358752 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-72debd01-8305-4770-ac82-dc2dd20f7d84 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:54.359537 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-72debd01-8305-4770-ac82-dc2dd20f7d84 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:54.359980 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-72debd01-8305-4770-ac82-dc2dd20f7d84 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:54.388370 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-faf12547-7eff-478d-b99f-2fb09e0f1d36 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:54.395757 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-faf12547-7eff-478d-b99f-2fb09e0f1d36 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987" status: 200 len: 1266 microversion: 2.1 time: 0.190832 Jan 18 16:35:54.396520 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 396/783] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:35:54 2022] GET /compute/v2.1/servers/a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987 => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:35:54.439509 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-72debd01-8305-4770-ac82-dc2dd20f7d84 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action" status: 200 len: 38350 microversion: 2.20 time: 0.091563 Jan 18 16:35:54.440170 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 388/784] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:35:54 2022] POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action => generated 38350 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:35:55.363647 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-bde715d4-bc97-4270-93be-86ea625a7f34 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:35:55.364197 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-bde715d4-bc97-4270-93be-86ea625a7f34 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:55.371455 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-bde715d4-bc97-4270-93be-86ea625a7f34 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:55.371922 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-bde715d4-bc97-4270-93be-86ea625a7f34 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:55.372693 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-bde715d4-bc97-4270-93be-86ea625a7f34 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:55.373168 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-bde715d4-bc97-4270-93be-86ea625a7f34 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:55.411783 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-097124cf-b532-4d34-bfcd-109e93c9cae4 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:35:55.412494 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-097124cf-b532-4d34-bfcd-109e93c9cae4 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:55.419977 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-097124cf-b532-4d34-bfcd-109e93c9cae4 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:55.420432 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-097124cf-b532-4d34-bfcd-109e93c9cae4 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:55.421268 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-097124cf-b532-4d34-bfcd-109e93c9cae4 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:55.421897 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-097124cf-b532-4d34-bfcd-109e93c9cae4 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:55.472093 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-bde715d4-bc97-4270-93be-86ea625a7f34 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0509d42df8844400b99d7c060ab98c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620d20ca2a943d7a89c58c0c1c74b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:55.480492 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-bde715d4-bc97-4270-93be-86ea625a7f34 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 200 len: 1512 microversion: 2.1 time: 0.120583 Jan 18 16:35:55.481078 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 397/785] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:35:55 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 1512 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:35:55.486886 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-8099e274-fe73-4e70-bfdb-cc10e859bc4b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:35:55.487863 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-8099e274-fe73-4e70-bfdb-cc10e859bc4b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:55.494828 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-8099e274-fe73-4e70-bfdb-cc10e859bc4b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:55.495277 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-8099e274-fe73-4e70-bfdb-cc10e859bc4b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:55.496060 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-8099e274-fe73-4e70-bfdb-cc10e859bc4b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:55.496485 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-8099e274-fe73-4e70-bfdb-cc10e859bc4b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:55.568189 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-8099e274-fe73-4e70-bfdb-cc10e859bc4b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action" status: 200 len: 38377 microversion: 2.20 time: 0.085627 Jan 18 16:35:55.568842 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 398/786] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:35:55 2022] POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action => generated 38377 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:35:55.575200 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [req-c7686cc9-99cd-450d-8d2f-60ac2152cd0b req-274b92f7-c99c-4e23-8d8d-0e5edf48bf3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "218c4c12-4e16-4dc9-8519-bcef764f01c6", "name": "network-vif-deleted", "tag": "684a69e2-8aee-429a-ad20-cba1e94ddb16"}]} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:35:55.576964 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:35:55.576964 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: warnings.warn(msg) Jan 18 16:35:55.586149 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-c7686cc9-99cd-450d-8d2f-60ac2152cd0b req-274b92f7-c99c-4e23-8d8d-0e5edf48bf3d service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:55.587411 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-c7686cc9-99cd-450d-8d2f-60ac2152cd0b req-274b92f7-c99c-4e23-8d8d-0e5edf48bf3d service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:55.599096 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.compute.server_external_events [req-c7686cc9-99cd-450d-8d2f-60ac2152cd0b req-274b92f7-c99c-4e23-8d8d-0e5edf48bf3d service nova] Creating event network-vif-deleted:684a69e2-8aee-429a-ad20-cba1e94ddb16 for instance 218c4c12-4e16-4dc9-8519-bcef764f01c6 on hv-cinder-78836 Jan 18 16:35:55.604436 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [req-c7686cc9-99cd-450d-8d2f-60ac2152cd0b req-274b92f7-c99c-4e23-8d8d-0e5edf48bf3d service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034052 Jan 18 16:35:55.605068 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 399/787] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:35:55.610297 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-dcb57c2a-13bf-49e0-a928-968e4b3a6a24 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:35:55.611057 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-dcb57c2a-13bf-49e0-a928-968e4b3a6a24 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:55.616702 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-097124cf-b532-4d34-bfcd-109e93c9cae4 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:55.617716 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-dcb57c2a-13bf-49e0-a928-968e4b3a6a24 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:55.618275 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-dcb57c2a-13bf-49e0-a928-968e4b3a6a24 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:55.619019 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-dcb57c2a-13bf-49e0-a928-968e4b3a6a24 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:55.619455 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-dcb57c2a-13bf-49e0-a928-968e4b3a6a24 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:55.624487 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-097124cf-b532-4d34-bfcd-109e93c9cae4 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987" status: 200 len: 1454 microversion: 2.1 time: 0.216707 Jan 18 16:35:55.625607 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 389/788] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:35:55 2022] GET /compute/v2.1/servers/a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987 => generated 1454 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:35:55.641599 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-34b4148b-7988-4dc8-90c5-81e58aede177 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:35:55.642251 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-34b4148b-7988-4dc8-90c5-81e58aede177 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:55.644039 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-dcb57c2a-13bf-49e0-a928-968e4b3a6a24 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/ips" status: 200 len: 153 microversion: 2.20 time: 0.037640 Jan 18 16:35:55.644658 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 400/789] 10.222.0.82 () {60 vars in 1288 bytes} [Tue Jan 18 16:35:55 2022] GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/ips => generated 153 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:35:55.651764 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-34b4148b-7988-4dc8-90c5-81e58aede177 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:55.652245 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-34b4148b-7988-4dc8-90c5-81e58aede177 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:55.653071 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-34b4148b-7988-4dc8-90c5-81e58aede177 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:55.653499 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-34b4148b-7988-4dc8-90c5-81e58aede177 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:55.797240 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-34b4148b-7988-4dc8-90c5-81e58aede177 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:55.805924 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-34b4148b-7988-4dc8-90c5-81e58aede177 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987" status: 200 len: 1454 microversion: 2.1 time: 0.167871 Jan 18 16:35:55.807692 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 390/790] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:35:55 2022] GET /compute/v2.1/servers/a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987 => generated 1454 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:35:56.497742 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-0e3ee1be-14d1-4d8d-8a50-c2045a5fdbbc tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:35:56.498387 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-0e3ee1be-14d1-4d8d-8a50-c2045a5fdbbc tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] [instance: 218c4c12-4e16-4dc9-8519-bcef764f01c6] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:56.504579 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0e3ee1be-14d1-4d8d-8a50-c2045a5fdbbc tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:56.505073 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0e3ee1be-14d1-4d8d-8a50-c2045a5fdbbc tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:56.505875 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0e3ee1be-14d1-4d8d-8a50-c2045a5fdbbc tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:56.506315 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0e3ee1be-14d1-4d8d-8a50-c2045a5fdbbc tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:56.521219 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.wsgi [None req-0e3ee1be-14d1-4d8d-8a50-c2045a5fdbbc tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] HTTP exception thrown: Instance 218c4c12-4e16-4dc9-8519-bcef764f01c6 could not be found. Jan 18 16:35:56.521814 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-0e3ee1be-14d1-4d8d-8a50-c2045a5fdbbc tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Returning 404 to user: Instance 218c4c12-4e16-4dc9-8519-bcef764f01c6 could not be found. {{(pid=116367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 16:35:56.523251 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-0e3ee1be-14d1-4d8d-8a50-c2045a5fdbbc tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6" status: 404 len: 111 microversion: 2.1 time: 0.028920 Jan 18 16:35:56.523933 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 401/791] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:35:56 2022] GET /compute/v2.1/servers/218c4c12-4e16-4dc9-8519-bcef764f01c6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 16:35:56.531842 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-2274cfba-39bc-4709-8ce8-41b35bc84bb7 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] Calling method '.version_select at 0x7f33a4954dc0>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:35:56.550715 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-2274cfba-39bc-4709-8ce8-41b35bc84bb7 tempest-TestMinimumBasicScenario-757587763 tempest-TestMinimumBasicScenario-757587763-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1007068540" status: 202 len: 0 microversion: 2.1 time: 0.022372 Jan 18 16:35:56.551295 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 391/792] 10.222.0.82 () {58 vars in 1271 bytes} [Tue Jan 18 16:35:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1007068540 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 18 16:35:57.525864 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [req-489b437b-cba9-4b8e-9949-7ec55b0ca20e req-62901e08-d59b-43ab-a95e-2994d9cc5032 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987", "tag": "3db787b2-9f3f-4ce3-98a8-15e5146e27d0"}]} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:35:57.527368 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:35:57.527368 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: warnings.warn(msg) Jan 18 16:35:57.535348 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-489b437b-cba9-4b8e-9949-7ec55b0ca20e req-62901e08-d59b-43ab-a95e-2994d9cc5032 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:57.535998 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-489b437b-cba9-4b8e-9949-7ec55b0ca20e req-62901e08-d59b-43ab-a95e-2994d9cc5032 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:57.548468 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.compute.server_external_events [req-489b437b-cba9-4b8e-9949-7ec55b0ca20e req-62901e08-d59b-43ab-a95e-2994d9cc5032 service nova] Creating event network-changed:3db787b2-9f3f-4ce3-98a8-15e5146e27d0 for instance a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987 on hv-cinder-78836 Jan 18 16:35:57.554327 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [req-489b437b-cba9-4b8e-9949-7ec55b0ca20e req-62901e08-d59b-43ab-a95e-2994d9cc5032 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031695 Jan 18 16:35:57.558275 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 402/793] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:35:57.750444 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-f7c47924-0bbe-45c5-b151-6e76d1afc340 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:35:57.751028 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-f7c47924-0bbe-45c5-b151-6e76d1afc340 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:57.759373 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f7c47924-0bbe-45c5-b151-6e76d1afc340 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:57.760102 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f7c47924-0bbe-45c5-b151-6e76d1afc340 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:57.760938 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f7c47924-0bbe-45c5-b151-6e76d1afc340 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:57.761391 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f7c47924-0bbe-45c5-b151-6e76d1afc340 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:57.786477 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.objects.instance [None req-f7c47924-0bbe-45c5-b151-6e76d1afc340 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lazy-loading 'flavor' on Instance uuid 0d44a3a6-2027-437a-86a6-a826f997f8fc {{(pid=116368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 18 16:35:58.059865 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-f7c47924-0bbe-45c5-b151-6e76d1afc340 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action" status: 202 len: 0 microversion: 2.20 time: 0.313506 Jan 18 16:35:58.060496 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 392/794] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:35:57 2022] POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 18 16:35:58.070922 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-44059b77-0f6d-4cd8-93e9-82f7c4c6b7b5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:35:58.071936 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-44059b77-0f6d-4cd8-93e9-82f7c4c6b7b5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:58.079042 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-44059b77-0f6d-4cd8-93e9-82f7c4c6b7b5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:58.079959 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-44059b77-0f6d-4cd8-93e9-82f7c4c6b7b5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:58.081354 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-44059b77-0f6d-4cd8-93e9-82f7c4c6b7b5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:58.082024 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-44059b77-0f6d-4cd8-93e9-82f7c4c6b7b5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:58.740387 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-44059b77-0f6d-4cd8-93e9-82f7c4c6b7b5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:58.748753 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-44059b77-0f6d-4cd8-93e9-82f7c4c6b7b5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:58.750515 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-44059b77-0f6d-4cd8-93e9-82f7c4c6b7b5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:35:58.751692 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-44059b77-0f6d-4cd8-93e9-82f7c4c6b7b5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc" status: 200 len: 1725 microversion: 2.20 time: 0.686765 Jan 18 16:35:58.752216 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 403/795] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:35:58 2022] GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc => generated 1725 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:35:59.774081 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-6704a94c-bfde-4cb2-a4e7-a73a16350f2d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:35:59.774917 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-6704a94c-bfde-4cb2-a4e7-a73a16350f2d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:35:59.781206 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-6704a94c-bfde-4cb2-a4e7-a73a16350f2d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:59.781876 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-6704a94c-bfde-4cb2-a4e7-a73a16350f2d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:35:59.782651 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-6704a94c-bfde-4cb2-a4e7-a73a16350f2d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:35:59.783234 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-6704a94c-bfde-4cb2-a4e7-a73a16350f2d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:00.028757 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-6704a94c-bfde-4cb2-a4e7-a73a16350f2d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:00.037357 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-6704a94c-bfde-4cb2-a4e7-a73a16350f2d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:00.039395 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-6704a94c-bfde-4cb2-a4e7-a73a16350f2d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:00.040567 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-6704a94c-bfde-4cb2-a4e7-a73a16350f2d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc" status: 200 len: 1725 microversion: 2.20 time: 0.271576 Jan 18 16:36:00.041250 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 393/796] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:35:59 2022] GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc => generated 1725 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 16:36:01.059520 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-c0f09636-94fc-4dd1-bfd7-ca56259e79b5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:36:01.060749 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-c0f09636-94fc-4dd1-bfd7-ca56259e79b5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:01.067836 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c0f09636-94fc-4dd1-bfd7-ca56259e79b5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:01.068312 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c0f09636-94fc-4dd1-bfd7-ca56259e79b5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:01.069812 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c0f09636-94fc-4dd1-bfd7-ca56259e79b5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:01.070645 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c0f09636-94fc-4dd1-bfd7-ca56259e79b5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:01.218107 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-c0f09636-94fc-4dd1-bfd7-ca56259e79b5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:01.226891 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-c0f09636-94fc-4dd1-bfd7-ca56259e79b5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:01.228373 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-c0f09636-94fc-4dd1-bfd7-ca56259e79b5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:01.229569 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-c0f09636-94fc-4dd1-bfd7-ca56259e79b5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc" status: 200 len: 1725 microversion: 2.20 time: 0.174215 Jan 18 16:36:01.230163 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 404/797] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:36:01 2022] GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:36:02.252833 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-7984d29a-90a3-424b-ac1d-a3585fac9881 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:36:02.253581 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-7984d29a-90a3-424b-ac1d-a3585fac9881 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:02.266631 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7984d29a-90a3-424b-ac1d-a3585fac9881 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:02.269120 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7984d29a-90a3-424b-ac1d-a3585fac9881 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:02.270721 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7984d29a-90a3-424b-ac1d-a3585fac9881 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:02.270721 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7984d29a-90a3-424b-ac1d-a3585fac9881 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:02.421104 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-7984d29a-90a3-424b-ac1d-a3585fac9881 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:02.429813 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-7984d29a-90a3-424b-ac1d-a3585fac9881 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:02.432626 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-7984d29a-90a3-424b-ac1d-a3585fac9881 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:02.434149 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-7984d29a-90a3-424b-ac1d-a3585fac9881 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc" status: 200 len: 1725 microversion: 2.20 time: 0.189596 Jan 18 16:36:02.435411 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 394/798] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:36:02 2022] GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc => generated 1725 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:36:03.453569 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-cca7184f-a0d6-4f86-878c-ecce68eda9ea tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:36:03.454472 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-cca7184f-a0d6-4f86-878c-ecce68eda9ea tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:03.461510 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-cca7184f-a0d6-4f86-878c-ecce68eda9ea tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:03.462217 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-cca7184f-a0d6-4f86-878c-ecce68eda9ea tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:03.463026 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-cca7184f-a0d6-4f86-878c-ecce68eda9ea tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:03.463466 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-cca7184f-a0d6-4f86-878c-ecce68eda9ea tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:03.639231 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-cca7184f-a0d6-4f86-878c-ecce68eda9ea tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:03.648951 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-cca7184f-a0d6-4f86-878c-ecce68eda9ea tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:03.650500 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-cca7184f-a0d6-4f86-878c-ecce68eda9ea tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:03.651662 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-cca7184f-a0d6-4f86-878c-ecce68eda9ea tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc" status: 200 len: 1725 microversion: 2.20 time: 0.202861 Jan 18 16:36:03.652398 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 405/799] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:36:03 2022] GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc => generated 1725 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:36:04.669674 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-456fd2fc-9bb1-4a00-b6f3-8c4cfcde8b32 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:36:04.670348 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-456fd2fc-9bb1-4a00-b6f3-8c4cfcde8b32 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:04.677000 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-456fd2fc-9bb1-4a00-b6f3-8c4cfcde8b32 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:04.677543 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-456fd2fc-9bb1-4a00-b6f3-8c4cfcde8b32 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:04.678919 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-456fd2fc-9bb1-4a00-b6f3-8c4cfcde8b32 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:04.679388 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-456fd2fc-9bb1-4a00-b6f3-8c4cfcde8b32 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:04.816819 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-456fd2fc-9bb1-4a00-b6f3-8c4cfcde8b32 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:04.830208 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-456fd2fc-9bb1-4a00-b6f3-8c4cfcde8b32 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:04.832495 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-456fd2fc-9bb1-4a00-b6f3-8c4cfcde8b32 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:04.834394 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-456fd2fc-9bb1-4a00-b6f3-8c4cfcde8b32 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc" status: 200 len: 1725 microversion: 2.20 time: 0.167913 Jan 18 16:36:04.834543 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 395/800] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:36:04 2022] GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:36:05.852815 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-340735a0-07f6-4e59-9e27-7b5441c9da31 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:36:05.853575 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-340735a0-07f6-4e59-9e27-7b5441c9da31 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:05.860082 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-340735a0-07f6-4e59-9e27-7b5441c9da31 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:05.860529 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-340735a0-07f6-4e59-9e27-7b5441c9da31 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:05.861361 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-340735a0-07f6-4e59-9e27-7b5441c9da31 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:05.861790 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-340735a0-07f6-4e59-9e27-7b5441c9da31 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:05.993723 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-340735a0-07f6-4e59-9e27-7b5441c9da31 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:06.001331 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-340735a0-07f6-4e59-9e27-7b5441c9da31 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:06.002808 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-340735a0-07f6-4e59-9e27-7b5441c9da31 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:06.003944 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-340735a0-07f6-4e59-9e27-7b5441c9da31 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc" status: 200 len: 1725 microversion: 2.20 time: 0.156181 Jan 18 16:36:06.004488 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 406/801] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:36:05 2022] GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:36:07.021854 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-b5f22e80-1b36-494d-9169-5844939e5381 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:36:07.022476 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-b5f22e80-1b36-494d-9169-5844939e5381 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:07.028827 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-b5f22e80-1b36-494d-9169-5844939e5381 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:07.029309 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-b5f22e80-1b36-494d-9169-5844939e5381 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:07.030110 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-b5f22e80-1b36-494d-9169-5844939e5381 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:07.030531 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-b5f22e80-1b36-494d-9169-5844939e5381 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:07.161638 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-b5f22e80-1b36-494d-9169-5844939e5381 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:07.174586 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-b5f22e80-1b36-494d-9169-5844939e5381 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:07.176142 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-b5f22e80-1b36-494d-9169-5844939e5381 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:07.177316 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-b5f22e80-1b36-494d-9169-5844939e5381 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc" status: 200 len: 1725 microversion: 2.20 time: 0.159193 Jan 18 16:36:07.177874 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 396/802] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:36:07 2022] GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:36:08.197794 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-86c97314-ad3d-4c91-9f61-144c8a611bb7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:36:08.198492 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-86c97314-ad3d-4c91-9f61-144c8a611bb7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:08.205019 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-86c97314-ad3d-4c91-9f61-144c8a611bb7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:08.205469 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-86c97314-ad3d-4c91-9f61-144c8a611bb7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:08.206266 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-86c97314-ad3d-4c91-9f61-144c8a611bb7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:08.206703 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-86c97314-ad3d-4c91-9f61-144c8a611bb7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:08.337370 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-86c97314-ad3d-4c91-9f61-144c8a611bb7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:08.344981 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-86c97314-ad3d-4c91-9f61-144c8a611bb7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:08.346473 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-86c97314-ad3d-4c91-9f61-144c8a611bb7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:08.347612 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-86c97314-ad3d-4c91-9f61-144c8a611bb7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc" status: 200 len: 1725 microversion: 2.20 time: 0.154715 Jan 18 16:36:08.348166 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 407/803] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:36:08 2022] GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:36:09.365886 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-7cae7fed-9d35-45bd-ba9c-fad7e0ee1b5a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:36:09.366478 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-7cae7fed-9d35-45bd-ba9c-fad7e0ee1b5a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:09.372998 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7cae7fed-9d35-45bd-ba9c-fad7e0ee1b5a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:09.373440 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7cae7fed-9d35-45bd-ba9c-fad7e0ee1b5a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:09.374203 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7cae7fed-9d35-45bd-ba9c-fad7e0ee1b5a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:09.374631 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7cae7fed-9d35-45bd-ba9c-fad7e0ee1b5a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:09.505302 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-7cae7fed-9d35-45bd-ba9c-fad7e0ee1b5a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:09.513794 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-7cae7fed-9d35-45bd-ba9c-fad7e0ee1b5a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:09.515301 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-7cae7fed-9d35-45bd-ba9c-fad7e0ee1b5a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:09.516484 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-7cae7fed-9d35-45bd-ba9c-fad7e0ee1b5a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc" status: 200 len: 1746 microversion: 2.20 time: 0.154320 Jan 18 16:36:09.517072 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 397/804] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:36:09 2022] GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:36:10.534712 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-07568ce6-9bbf-487e-912e-01d8f1092904 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:36:10.535432 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-07568ce6-9bbf-487e-912e-01d8f1092904 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:10.542721 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-07568ce6-9bbf-487e-912e-01d8f1092904 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:10.543171 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-07568ce6-9bbf-487e-912e-01d8f1092904 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:10.543950 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-07568ce6-9bbf-487e-912e-01d8f1092904 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:10.544386 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-07568ce6-9bbf-487e-912e-01d8f1092904 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:10.672884 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-07568ce6-9bbf-487e-912e-01d8f1092904 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:10.682126 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-07568ce6-9bbf-487e-912e-01d8f1092904 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:10.683604 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-07568ce6-9bbf-487e-912e-01d8f1092904 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:10.684746 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-07568ce6-9bbf-487e-912e-01d8f1092904 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc" status: 200 len: 1746 microversion: 2.20 time: 0.153844 Jan 18 16:36:10.685332 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 408/805] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:36:10 2022] GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:36:11.703181 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-77f1002e-2db7-423d-8c79-054c4815c70d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:36:11.704592 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-77f1002e-2db7-423d-8c79-054c4815c70d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:11.712641 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-77f1002e-2db7-423d-8c79-054c4815c70d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:11.713371 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-77f1002e-2db7-423d-8c79-054c4815c70d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:11.714331 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-77f1002e-2db7-423d-8c79-054c4815c70d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:11.714766 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-77f1002e-2db7-423d-8c79-054c4815c70d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:11.868903 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-77f1002e-2db7-423d-8c79-054c4815c70d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:11.877810 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-77f1002e-2db7-423d-8c79-054c4815c70d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:11.879651 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-77f1002e-2db7-423d-8c79-054c4815c70d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:11.880891 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-77f1002e-2db7-423d-8c79-054c4815c70d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc" status: 200 len: 1741 microversion: 2.20 time: 0.181568 Jan 18 16:36:11.882102 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 398/806] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:36:11 2022] GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc => generated 1741 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:36:12.900179 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-018e4371-7352-4abc-9d1d-88c579f497da tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:36:12.901376 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-018e4371-7352-4abc-9d1d-88c579f497da tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:12.907701 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-018e4371-7352-4abc-9d1d-88c579f497da tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:12.908426 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-018e4371-7352-4abc-9d1d-88c579f497da tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:12.909407 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-018e4371-7352-4abc-9d1d-88c579f497da tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:12.909836 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-018e4371-7352-4abc-9d1d-88c579f497da tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:13.064144 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-018e4371-7352-4abc-9d1d-88c579f497da tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:13.074656 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-018e4371-7352-4abc-9d1d-88c579f497da tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:13.076475 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-018e4371-7352-4abc-9d1d-88c579f497da tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:13.077900 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-018e4371-7352-4abc-9d1d-88c579f497da tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc" status: 200 len: 1741 microversion: 2.20 time: 0.182271 Jan 18 16:36:13.078446 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 409/807] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:36:12 2022] GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc => generated 1741 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:36:13.362323 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [req-d53d689a-9f18-4b19-b87c-ccbb6ecc47e8 req-ee1d8bef-f265-4879-a308-f9878d5b81cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d44a3a6-2027-437a-86a6-a826f997f8fc", "name": "network-vif-plugged", "status": "completed", "tag": "3214e15a-2bf8-4e9c-b215-8b914b1912ec"}]} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:36:13.365279 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:36:13.365279 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: warnings.warn(msg) Jan 18 16:36:13.379951 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-d53d689a-9f18-4b19-b87c-ccbb6ecc47e8 req-ee1d8bef-f265-4879-a308-f9878d5b81cc service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:13.382175 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-d53d689a-9f18-4b19-b87c-ccbb6ecc47e8 req-ee1d8bef-f265-4879-a308-f9878d5b81cc service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:13.398032 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.compute.server_external_events [req-d53d689a-9f18-4b19-b87c-ccbb6ecc47e8 req-ee1d8bef-f265-4879-a308-f9878d5b81cc service nova] Creating event network-vif-plugged:3214e15a-2bf8-4e9c-b215-8b914b1912ec for instance 0d44a3a6-2027-437a-86a6-a826f997f8fc on hv-cinder-78836 Jan 18 16:36:13.406176 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [req-d53d689a-9f18-4b19-b87c-ccbb6ecc47e8 req-ee1d8bef-f265-4879-a308-f9878d5b81cc service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047065 Jan 18 16:36:13.407648 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 399/808] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 16:36:14.097665 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-e19e1f28-6449-4fcd-a3d0-15d710982dc3 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:36:14.098883 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-e19e1f28-6449-4fcd-a3d0-15d710982dc3 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:14.106702 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e19e1f28-6449-4fcd-a3d0-15d710982dc3 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:14.107711 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e19e1f28-6449-4fcd-a3d0-15d710982dc3 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:14.108611 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e19e1f28-6449-4fcd-a3d0-15d710982dc3 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:14.109160 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e19e1f28-6449-4fcd-a3d0-15d710982dc3 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:14.273834 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-e19e1f28-6449-4fcd-a3d0-15d710982dc3 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:14.283295 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-e19e1f28-6449-4fcd-a3d0-15d710982dc3 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:14.285171 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-e19e1f28-6449-4fcd-a3d0-15d710982dc3 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:14.286546 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-e19e1f28-6449-4fcd-a3d0-15d710982dc3 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc" status: 200 len: 1741 microversion: 2.20 time: 0.193025 Jan 18 16:36:14.287385 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 410/809] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:36:14 2022] GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc => generated 1741 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:36:15.306705 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-88f0019a-1a55-457f-b366-b1676c280c95 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:36:15.306705 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-88f0019a-1a55-457f-b366-b1676c280c95 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:15.313616 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-88f0019a-1a55-457f-b366-b1676c280c95 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:15.314058 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-88f0019a-1a55-457f-b366-b1676c280c95 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:15.314831 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-88f0019a-1a55-457f-b366-b1676c280c95 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:15.315259 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-88f0019a-1a55-457f-b366-b1676c280c95 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:15.479720 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-88f0019a-1a55-457f-b366-b1676c280c95 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:15.487725 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-88f0019a-1a55-457f-b366-b1676c280c95 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:15.489275 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-88f0019a-1a55-457f-b366-b1676c280c95 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:15.492527 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-88f0019a-1a55-457f-b366-b1676c280c95 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc" status: 200 len: 1741 microversion: 2.20 time: 0.188757 Jan 18 16:36:15.492527 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 400/810] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:36:15 2022] GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc => generated 1741 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:36:16.509610 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-2a98ff93-085c-4919-9dee-eb96a9817fdb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:36:16.510411 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-2a98ff93-085c-4919-9dee-eb96a9817fdb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:16.517308 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2a98ff93-085c-4919-9dee-eb96a9817fdb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:16.518873 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2a98ff93-085c-4919-9dee-eb96a9817fdb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:16.521329 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2a98ff93-085c-4919-9dee-eb96a9817fdb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:16.521860 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2a98ff93-085c-4919-9dee-eb96a9817fdb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:16.670425 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-2a98ff93-085c-4919-9dee-eb96a9817fdb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:16.680135 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-2a98ff93-085c-4919-9dee-eb96a9817fdb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:16.681616 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-2a98ff93-085c-4919-9dee-eb96a9817fdb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:16.682808 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-2a98ff93-085c-4919-9dee-eb96a9817fdb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc" status: 200 len: 1741 microversion: 2.20 time: 0.176942 Jan 18 16:36:16.683553 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 411/811] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:36:16 2022] GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc => generated 1741 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:36:17.701979 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-dafba69b-8e92-472b-a45b-e36af60fa36f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:36:17.702570 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-dafba69b-8e92-472b-a45b-e36af60fa36f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:17.710356 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-dafba69b-8e92-472b-a45b-e36af60fa36f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:17.713937 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-dafba69b-8e92-472b-a45b-e36af60fa36f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:17.715412 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-dafba69b-8e92-472b-a45b-e36af60fa36f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:17.715846 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-dafba69b-8e92-472b-a45b-e36af60fa36f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:17.870808 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-dafba69b-8e92-472b-a45b-e36af60fa36f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:17.879991 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-dafba69b-8e92-472b-a45b-e36af60fa36f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:17.881819 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-dafba69b-8e92-472b-a45b-e36af60fa36f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:17.883670 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-dafba69b-8e92-472b-a45b-e36af60fa36f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc" status: 200 len: 1741 microversion: 2.20 time: 0.185307 Jan 18 16:36:17.884228 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 401/812] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:36:17 2022] GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc => generated 1741 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:36:18.901576 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-956d953c-f998-4bab-a96d-6d53d2d21b6e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:36:18.902791 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-956d953c-f998-4bab-a96d-6d53d2d21b6e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:18.909454 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-956d953c-f998-4bab-a96d-6d53d2d21b6e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:18.910394 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-956d953c-f998-4bab-a96d-6d53d2d21b6e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:18.911197 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-956d953c-f998-4bab-a96d-6d53d2d21b6e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:18.911636 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-956d953c-f998-4bab-a96d-6d53d2d21b6e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:19.394893 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-956d953c-f998-4bab-a96d-6d53d2d21b6e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:19.406176 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-956d953c-f998-4bab-a96d-6d53d2d21b6e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:19.408094 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-956d953c-f998-4bab-a96d-6d53d2d21b6e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:19.409403 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-956d953c-f998-4bab-a96d-6d53d2d21b6e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc" status: 200 len: 1741 microversion: 2.20 time: 0.511437 Jan 18 16:36:19.410049 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 412/813] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:36:18 2022] GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc => generated 1741 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 16:36:20.431636 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-0e1bab5a-2b40-43a9-871e-60fce3fc92cb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:36:20.432777 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-0e1bab5a-2b40-43a9-871e-60fce3fc92cb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:20.443890 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0e1bab5a-2b40-43a9-871e-60fce3fc92cb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:20.444751 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0e1bab5a-2b40-43a9-871e-60fce3fc92cb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:20.447010 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0e1bab5a-2b40-43a9-871e-60fce3fc92cb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:20.447819 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0e1bab5a-2b40-43a9-871e-60fce3fc92cb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:20.672827 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-0e1bab5a-2b40-43a9-871e-60fce3fc92cb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:20.682563 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-0e1bab5a-2b40-43a9-871e-60fce3fc92cb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:20.684014 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-0e1bab5a-2b40-43a9-871e-60fce3fc92cb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:20.685261 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-0e1bab5a-2b40-43a9-871e-60fce3fc92cb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc" status: 200 len: 1723 microversion: 2.20 time: 0.260933 Jan 18 16:36:20.685811 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 402/814] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:36:20 2022] GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc => generated 1723 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:36:21.703358 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-78dd0b20-c490-479b-8ae3-acc02eb380dd tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:36:21.704004 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-78dd0b20-c490-479b-8ae3-acc02eb380dd tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:21.710924 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-78dd0b20-c490-479b-8ae3-acc02eb380dd tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:21.711377 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-78dd0b20-c490-479b-8ae3-acc02eb380dd tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:21.712164 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-78dd0b20-c490-479b-8ae3-acc02eb380dd tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:21.712596 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-78dd0b20-c490-479b-8ae3-acc02eb380dd tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:21.844139 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-78dd0b20-c490-479b-8ae3-acc02eb380dd tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:21.852334 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-78dd0b20-c490-479b-8ae3-acc02eb380dd tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:21.853856 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-78dd0b20-c490-479b-8ae3-acc02eb380dd tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:21.855002 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-78dd0b20-c490-479b-8ae3-acc02eb380dd tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc" status: 200 len: 1723 microversion: 2.20 time: 0.155396 Jan 18 16:36:21.855553 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 413/815] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:36:21 2022] GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:36:22.873001 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-4f76a473-65b2-40c6-98b7-991df2d2b810 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:36:22.873541 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-4f76a473-65b2-40c6-98b7-991df2d2b810 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:22.879678 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4f76a473-65b2-40c6-98b7-991df2d2b810 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:22.880129 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4f76a473-65b2-40c6-98b7-991df2d2b810 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:22.881059 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4f76a473-65b2-40c6-98b7-991df2d2b810 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:22.881613 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4f76a473-65b2-40c6-98b7-991df2d2b810 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:23.012557 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-4f76a473-65b2-40c6-98b7-991df2d2b810 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:23.020071 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-4f76a473-65b2-40c6-98b7-991df2d2b810 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:23.021572 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-4f76a473-65b2-40c6-98b7-991df2d2b810 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:23.022697 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-4f76a473-65b2-40c6-98b7-991df2d2b810 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc" status: 200 len: 1666 microversion: 2.20 time: 0.153680 Jan 18 16:36:23.024020 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 403/816] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:36:22 2022] GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc => generated 1666 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 16:36:23.040913 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-5bb1be30-4b54-4c0b-9639-85caec2e4bba tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "125f6dc2-e1d8-400e-97e6-01b137702995"}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:36:23.042013 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-5bb1be30-4b54-4c0b-9639-85caec2e4bba tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:23.048214 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-5bb1be30-4b54-4c0b-9639-85caec2e4bba tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:23.048673 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-5bb1be30-4b54-4c0b-9639-85caec2e4bba tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:23.049493 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-5bb1be30-4b54-4c0b-9639-85caec2e4bba tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:23.049933 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-5bb1be30-4b54-4c0b-9639-85caec2e4bba tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:23.307597 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-5bb1be30-4b54-4c0b-9639-85caec2e4bba tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.270807 Jan 18 16:36:23.308199 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 414/817] 10.222.0.82 () {62 vars in 1363 bytes} [Tue Jan 18 16:36:23 2022] POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/os-volume_attachments => generated 188 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 18 16:36:23.368220 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [req-2f7afa13-74b2-46db-837d-93c492d61e7d req-c5ea891f-0f07-48a6-a61c-a34aa67df33a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d44a3a6-2027-437a-86a6-a826f997f8fc", "name": "network-vif-unplugged", "status": "completed", "tag": "3214e15a-2bf8-4e9c-b215-8b914b1912ec"}]} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:36:23.370288 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:36:23.370288 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: warnings.warn(msg) Jan 18 16:36:23.378123 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-2f7afa13-74b2-46db-837d-93c492d61e7d req-c5ea891f-0f07-48a6-a61c-a34aa67df33a service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:23.379019 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-2f7afa13-74b2-46db-837d-93c492d61e7d req-c5ea891f-0f07-48a6-a61c-a34aa67df33a service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:23.392489 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.compute.server_external_events [req-2f7afa13-74b2-46db-837d-93c492d61e7d req-c5ea891f-0f07-48a6-a61c-a34aa67df33a service nova] Unable to find a host for instance 0d44a3a6-2027-437a-86a6-a826f997f8fc. Dropping event network-vif-unplugged {{(pid=116368) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jan 18 16:36:23.393461 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [req-2f7afa13-74b2-46db-837d-93c492d61e7d req-c5ea891f-0f07-48a6-a61c-a34aa67df33a service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030223 Jan 18 16:36:23.394117 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 404/818] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:36:23 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jan 18 16:36:23.422614 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-e1920f2f-51b0-4407-9f8b-800d85da9752 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:36:23.423205 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-e1920f2f-51b0-4407-9f8b-800d85da9752 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:23.430030 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e1920f2f-51b0-4407-9f8b-800d85da9752 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:23.430486 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e1920f2f-51b0-4407-9f8b-800d85da9752 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:23.431273 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e1920f2f-51b0-4407-9f8b-800d85da9752 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:23.431696 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e1920f2f-51b0-4407-9f8b-800d85da9752 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:23.643589 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-e1920f2f-51b0-4407-9f8b-800d85da9752 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "DELETE /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/os-volume_attachments/125f6dc2-e1d8-400e-97e6-01b137702995" status: 202 len: 0 microversion: 2.20 time: 0.224617 Jan 18 16:36:23.644073 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 415/819] 10.222.0.82 () {60 vars in 1456 bytes} [Tue Jan 18 16:36:23 2022] DELETE /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/os-volume_attachments/125f6dc2-e1d8-400e-97e6-01b137702995 => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 18 16:36:23.699746 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-971a5785-00ff-4b6b-8f91-a20197b78adb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:36:23.700319 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-971a5785-00ff-4b6b-8f91-a20197b78adb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:23.706179 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-971a5785-00ff-4b6b-8f91-a20197b78adb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:23.706648 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-971a5785-00ff-4b6b-8f91-a20197b78adb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:23.707483 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-971a5785-00ff-4b6b-8f91-a20197b78adb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:23.707919 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-971a5785-00ff-4b6b-8f91-a20197b78adb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:23.797919 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-971a5785-00ff-4b6b-8f91-a20197b78adb tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action" status: 202 len: 0 microversion: 2.20 time: 0.101745 Jan 18 16:36:23.798531 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 405/820] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Jan 18 16:36:23 2022] POST /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 18 16:36:23.806504 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-ba7a3caf-f544-4dfe-b180-1d67d8adfbd8 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:36:23.807113 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-ba7a3caf-f544-4dfe-b180-1d67d8adfbd8 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:23.812787 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-ba7a3caf-f544-4dfe-b180-1d67d8adfbd8 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:23.813276 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-ba7a3caf-f544-4dfe-b180-1d67d8adfbd8 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:23.814070 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-ba7a3caf-f544-4dfe-b180-1d67d8adfbd8 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:23.814506 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-ba7a3caf-f544-4dfe-b180-1d67d8adfbd8 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:23.971931 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-ba7a3caf-f544-4dfe-b180-1d67d8adfbd8 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:23.982763 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-ba7a3caf-f544-4dfe-b180-1d67d8adfbd8 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:23.984708 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-ba7a3caf-f544-4dfe-b180-1d67d8adfbd8 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:23.985930 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-ba7a3caf-f544-4dfe-b180-1d67d8adfbd8 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc" status: 200 len: 1674 microversion: 2.20 time: 0.183162 Jan 18 16:36:23.986486 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 416/821] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:36:23 2022] GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc => generated 1674 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:36:25.005036 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-f101fe2d-1d0f-4894-8d20-6e0688eb967e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:36:25.005606 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-f101fe2d-1d0f-4894-8d20-6e0688eb967e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:25.012621 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f101fe2d-1d0f-4894-8d20-6e0688eb967e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:25.013115 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f101fe2d-1d0f-4894-8d20-6e0688eb967e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:25.013906 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f101fe2d-1d0f-4894-8d20-6e0688eb967e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:25.014350 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f101fe2d-1d0f-4894-8d20-6e0688eb967e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:25.204826 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-f101fe2d-1d0f-4894-8d20-6e0688eb967e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:25.214020 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-f101fe2d-1d0f-4894-8d20-6e0688eb967e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:25.215495 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-f101fe2d-1d0f-4894-8d20-6e0688eb967e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:25.216656 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-f101fe2d-1d0f-4894-8d20-6e0688eb967e tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc" status: 200 len: 1732 microversion: 2.20 time: 0.215511 Jan 18 16:36:25.217247 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 406/822] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:36:25 2022] GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc => generated 1732 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:36:26.240478 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-03ddff46-d282-4dc4-b87d-66c4b4ac9659 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:36:26.241140 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-03ddff46-d282-4dc4-b87d-66c4b4ac9659 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:26.252384 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-03ddff46-d282-4dc4-b87d-66c4b4ac9659 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:26.252866 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-03ddff46-d282-4dc4-b87d-66c4b4ac9659 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:26.253826 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-03ddff46-d282-4dc4-b87d-66c4b4ac9659 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:26.254274 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-03ddff46-d282-4dc4-b87d-66c4b4ac9659 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:26.405755 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-03ddff46-d282-4dc4-b87d-66c4b4ac9659 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:26.413752 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-03ddff46-d282-4dc4-b87d-66c4b4ac9659 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:26.416002 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-03ddff46-d282-4dc4-b87d-66c4b4ac9659 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:26.417460 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-03ddff46-d282-4dc4-b87d-66c4b4ac9659 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc" status: 200 len: 1732 microversion: 2.20 time: 0.185925 Jan 18 16:36:26.427877 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 417/823] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:36:26 2022] GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc => generated 1732 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:36:27.435808 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-3f241377-f490-426c-a8e0-9f577102f07b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:36:27.436392 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-3f241377-f490-426c-a8e0-9f577102f07b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:27.442940 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3f241377-f490-426c-a8e0-9f577102f07b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:27.443381 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3f241377-f490-426c-a8e0-9f577102f07b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:27.444194 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3f241377-f490-426c-a8e0-9f577102f07b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:27.444692 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3f241377-f490-426c-a8e0-9f577102f07b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:27.582041 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-3f241377-f490-426c-a8e0-9f577102f07b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:27.591006 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-3f241377-f490-426c-a8e0-9f577102f07b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:27.592720 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-3f241377-f490-426c-a8e0-9f577102f07b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:27.593925 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-3f241377-f490-426c-a8e0-9f577102f07b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc" status: 200 len: 1732 microversion: 2.20 time: 0.161772 Jan 18 16:36:27.594698 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 407/824] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:36:27 2022] GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:36:28.613155 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-38d0d8a2-1dfb-48ae-bdc6-1953358f631d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:36:28.613918 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-38d0d8a2-1dfb-48ae-bdc6-1953358f631d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:28.620809 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-38d0d8a2-1dfb-48ae-bdc6-1953358f631d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:28.621459 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-38d0d8a2-1dfb-48ae-bdc6-1953358f631d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:28.622294 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-38d0d8a2-1dfb-48ae-bdc6-1953358f631d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:28.622732 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-38d0d8a2-1dfb-48ae-bdc6-1953358f631d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:28.773831 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-38d0d8a2-1dfb-48ae-bdc6-1953358f631d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:28.781889 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-38d0d8a2-1dfb-48ae-bdc6-1953358f631d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:28.783359 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-38d0d8a2-1dfb-48ae-bdc6-1953358f631d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:28.784509 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-38d0d8a2-1dfb-48ae-bdc6-1953358f631d tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc" status: 200 len: 1732 microversion: 2.20 time: 0.175068 Jan 18 16:36:28.785091 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 418/825] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:36:28 2022] GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc => generated 1732 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:36:29.803386 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-462db4df-f5dc-42f3-b024-4a296eb3c104 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:36:29.804835 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-462db4df-f5dc-42f3-b024-4a296eb3c104 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:29.811321 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-462db4df-f5dc-42f3-b024-4a296eb3c104 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:29.811863 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-462db4df-f5dc-42f3-b024-4a296eb3c104 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:29.812718 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-462db4df-f5dc-42f3-b024-4a296eb3c104 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:29.813266 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-462db4df-f5dc-42f3-b024-4a296eb3c104 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:29.964550 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-462db4df-f5dc-42f3-b024-4a296eb3c104 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:29.972789 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-462db4df-f5dc-42f3-b024-4a296eb3c104 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:29.974420 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-462db4df-f5dc-42f3-b024-4a296eb3c104 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:29.975667 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-462db4df-f5dc-42f3-b024-4a296eb3c104 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc" status: 200 len: 1732 microversion: 2.20 time: 0.175962 Jan 18 16:36:29.977411 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 408/826] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:36:29 2022] GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc => generated 1732 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:36:30.995620 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-26f548fa-7f67-4685-a5a0-7a13376df224 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:36:30.997373 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-26f548fa-7f67-4685-a5a0-7a13376df224 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:31.004332 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-26f548fa-7f67-4685-a5a0-7a13376df224 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:31.005274 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-26f548fa-7f67-4685-a5a0-7a13376df224 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:31.006358 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-26f548fa-7f67-4685-a5a0-7a13376df224 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:31.007643 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-26f548fa-7f67-4685-a5a0-7a13376df224 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:31.149775 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-26f548fa-7f67-4685-a5a0-7a13376df224 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:31.159011 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-26f548fa-7f67-4685-a5a0-7a13376df224 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:31.160543 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-26f548fa-7f67-4685-a5a0-7a13376df224 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:31.161737 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-26f548fa-7f67-4685-a5a0-7a13376df224 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc" status: 200 len: 1732 microversion: 2.20 time: 0.170378 Jan 18 16:36:31.162483 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 419/827] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:36:30 2022] GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc => generated 1732 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:36:31.668545 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-94c6100c-a551-4338-8687-51d8009ae847 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:36:31.669277 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-94c6100c-a551-4338-8687-51d8009ae847 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] [instance: d5f46b70-ff39-46b9-912c-206b0683ed70] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:31.675527 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-94c6100c-a551-4338-8687-51d8009ae847 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:31.676006 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-94c6100c-a551-4338-8687-51d8009ae847 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:31.677310 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-94c6100c-a551-4338-8687-51d8009ae847 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:31.677945 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-94c6100c-a551-4338-8687-51d8009ae847 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:31.702968 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.objects.instance [None req-94c6100c-a551-4338-8687-51d8009ae847 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lazy-loading 'flavor' on Instance uuid d5f46b70-ff39-46b9-912c-206b0683ed70 {{(pid=116368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 18 16:36:31.791809 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-94c6100c-a551-4338-8687-51d8009ae847 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] 10.222.0.82 "POST /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70/action" status: 202 len: 0 microversion: 2.1 time: 0.125415 Jan 18 16:36:31.795442 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 409/828] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:36:31 2022] POST /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:36:31.804362 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-a5918846-ad96-4a98-b416-90260675a3f6 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:36:31.805597 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-a5918846-ad96-4a98-b416-90260675a3f6 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] [instance: d5f46b70-ff39-46b9-912c-206b0683ed70] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:31.811842 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a5918846-ad96-4a98-b416-90260675a3f6 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:31.812297 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a5918846-ad96-4a98-b416-90260675a3f6 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:31.813353 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a5918846-ad96-4a98-b416-90260675a3f6 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:31.813949 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a5918846-ad96-4a98-b416-90260675a3f6 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:31.969832 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-a5918846-ad96-4a98-b416-90260675a3f6 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2d1245fe3f4bf596e1c0f6978e34bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b7bab53ef4d6e869362551b3cfb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:31.977952 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-a5918846-ad96-4a98-b416-90260675a3f6 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] 10.222.0.82 "GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70" status: 200 len: 1567 microversion: 2.1 time: 0.177465 Jan 18 16:36:31.978728 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 420/829] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:36:31 2022] GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70 => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:36:32.181146 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-6af430ec-f4e5-4155-9c76-3f03d405cd4a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:36:32.181798 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-6af430ec-f4e5-4155-9c76-3f03d405cd4a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:32.187984 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-6af430ec-f4e5-4155-9c76-3f03d405cd4a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:32.188432 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-6af430ec-f4e5-4155-9c76-3f03d405cd4a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:32.189302 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-6af430ec-f4e5-4155-9c76-3f03d405cd4a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:32.189737 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-6af430ec-f4e5-4155-9c76-3f03d405cd4a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:32.338214 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-6af430ec-f4e5-4155-9c76-3f03d405cd4a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:32.348804 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-6af430ec-f4e5-4155-9c76-3f03d405cd4a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:32.350757 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-6af430ec-f4e5-4155-9c76-3f03d405cd4a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:32.352784 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-6af430ec-f4e5-4155-9c76-3f03d405cd4a tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc" status: 200 len: 1732 microversion: 2.20 time: 0.176543 Jan 18 16:36:32.364861 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 410/830] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:36:32 2022] GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc => generated 1732 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 16:36:32.995745 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-d81d8d3d-28d9-418d-96b7-9bf3141b0098 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:36:32.996374 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-d81d8d3d-28d9-418d-96b7-9bf3141b0098 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] [instance: d5f46b70-ff39-46b9-912c-206b0683ed70] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:33.002932 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-d81d8d3d-28d9-418d-96b7-9bf3141b0098 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:33.003383 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-d81d8d3d-28d9-418d-96b7-9bf3141b0098 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:33.004168 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-d81d8d3d-28d9-418d-96b7-9bf3141b0098 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:33.004603 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-d81d8d3d-28d9-418d-96b7-9bf3141b0098 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:33.139330 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-d81d8d3d-28d9-418d-96b7-9bf3141b0098 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2d1245fe3f4bf596e1c0f6978e34bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b7bab53ef4d6e869362551b3cfb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:33.146655 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-d81d8d3d-28d9-418d-96b7-9bf3141b0098 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] 10.222.0.82 "GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70" status: 200 len: 1567 microversion: 2.1 time: 0.155250 Jan 18 16:36:33.147264 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 421/831] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:36:32 2022] GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:36:33.372052 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-06a08944-ff3f-4437-90d1-1f0121771c87 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:36:33.372699 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-06a08944-ff3f-4437-90d1-1f0121771c87 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:33.378872 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-06a08944-ff3f-4437-90d1-1f0121771c87 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:33.379322 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-06a08944-ff3f-4437-90d1-1f0121771c87 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:33.380103 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-06a08944-ff3f-4437-90d1-1f0121771c87 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:33.380541 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-06a08944-ff3f-4437-90d1-1f0121771c87 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:33.515773 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-06a08944-ff3f-4437-90d1-1f0121771c87 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:33.523436 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-06a08944-ff3f-4437-90d1-1f0121771c87 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:33.524903 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-06a08944-ff3f-4437-90d1-1f0121771c87 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:33.526053 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-06a08944-ff3f-4437-90d1-1f0121771c87 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc" status: 200 len: 1732 microversion: 2.20 time: 0.158363 Jan 18 16:36:33.526605 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 411/832] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:36:33 2022] GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:36:34.163879 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-caf87a42-8f2d-4621-ba4e-3abfd513820d tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:36:34.164475 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-caf87a42-8f2d-4621-ba4e-3abfd513820d tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] [instance: d5f46b70-ff39-46b9-912c-206b0683ed70] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:34.170908 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-caf87a42-8f2d-4621-ba4e-3abfd513820d tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:34.171365 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-caf87a42-8f2d-4621-ba4e-3abfd513820d tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:34.172141 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-caf87a42-8f2d-4621-ba4e-3abfd513820d tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:34.172575 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-caf87a42-8f2d-4621-ba4e-3abfd513820d tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:34.310539 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-caf87a42-8f2d-4621-ba4e-3abfd513820d tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2d1245fe3f4bf596e1c0f6978e34bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b7bab53ef4d6e869362551b3cfb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:34.318071 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-caf87a42-8f2d-4621-ba4e-3abfd513820d tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] 10.222.0.82 "GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70" status: 200 len: 1567 microversion: 2.1 time: 0.158414 Jan 18 16:36:34.318633 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 422/833] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:36:34 2022] GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:36:34.544439 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-3fc91a2d-4fa3-4ba4-8fc7-ab190405ecb9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:36:34.545047 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-3fc91a2d-4fa3-4ba4-8fc7-ab190405ecb9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:34.551119 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3fc91a2d-4fa3-4ba4-8fc7-ab190405ecb9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:34.551558 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3fc91a2d-4fa3-4ba4-8fc7-ab190405ecb9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:34.552318 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3fc91a2d-4fa3-4ba4-8fc7-ab190405ecb9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:34.552743 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3fc91a2d-4fa3-4ba4-8fc7-ab190405ecb9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:34.689991 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-3fc91a2d-4fa3-4ba4-8fc7-ab190405ecb9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:34.697985 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-3fc91a2d-4fa3-4ba4-8fc7-ab190405ecb9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:34.699475 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-3fc91a2d-4fa3-4ba4-8fc7-ab190405ecb9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:34.700621 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-3fc91a2d-4fa3-4ba4-8fc7-ab190405ecb9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc" status: 200 len: 1732 microversion: 2.20 time: 0.159812 Jan 18 16:36:34.701258 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 412/834] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:36:34 2022] GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:36:35.334578 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-15ce2948-53f7-47ea-a983-fefc640e3351 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:36:35.335826 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-15ce2948-53f7-47ea-a983-fefc640e3351 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] [instance: d5f46b70-ff39-46b9-912c-206b0683ed70] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:35.342112 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-15ce2948-53f7-47ea-a983-fefc640e3351 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:35.342560 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-15ce2948-53f7-47ea-a983-fefc640e3351 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:35.343343 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-15ce2948-53f7-47ea-a983-fefc640e3351 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:35.343774 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-15ce2948-53f7-47ea-a983-fefc640e3351 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:35.479837 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-15ce2948-53f7-47ea-a983-fefc640e3351 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2d1245fe3f4bf596e1c0f6978e34bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b7bab53ef4d6e869362551b3cfb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:35.487928 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-15ce2948-53f7-47ea-a983-fefc640e3351 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] 10.222.0.82 "GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70" status: 200 len: 1567 microversion: 2.1 time: 0.156969 Jan 18 16:36:35.488611 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 423/835] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:36:35 2022] GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:36:35.719201 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-29397870-b4e8-4bbc-8674-23b156e755c4 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:36:35.719810 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-29397870-b4e8-4bbc-8674-23b156e755c4 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:35.726661 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-29397870-b4e8-4bbc-8674-23b156e755c4 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:35.727107 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-29397870-b4e8-4bbc-8674-23b156e755c4 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:35.727882 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-29397870-b4e8-4bbc-8674-23b156e755c4 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:35.728319 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-29397870-b4e8-4bbc-8674-23b156e755c4 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:35.862439 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-29397870-b4e8-4bbc-8674-23b156e755c4 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:35.871164 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-29397870-b4e8-4bbc-8674-23b156e755c4 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:35.872657 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-29397870-b4e8-4bbc-8674-23b156e755c4 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:35.873835 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-29397870-b4e8-4bbc-8674-23b156e755c4 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc" status: 200 len: 1732 microversion: 2.20 time: 0.158324 Jan 18 16:36:35.874417 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 413/836] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:36:35 2022] GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:36:36.506428 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-6b4b485b-2796-4fd0-a73f-93c69dcbf1ee tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:36:36.507642 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-6b4b485b-2796-4fd0-a73f-93c69dcbf1ee tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] [instance: d5f46b70-ff39-46b9-912c-206b0683ed70] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:36.513943 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6b4b485b-2796-4fd0-a73f-93c69dcbf1ee tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:36.514398 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6b4b485b-2796-4fd0-a73f-93c69dcbf1ee tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:36.515236 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6b4b485b-2796-4fd0-a73f-93c69dcbf1ee tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:36.515614 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6b4b485b-2796-4fd0-a73f-93c69dcbf1ee tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:36.645009 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-6b4b485b-2796-4fd0-a73f-93c69dcbf1ee tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2d1245fe3f4bf596e1c0f6978e34bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b7bab53ef4d6e869362551b3cfb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:36.652574 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-6b4b485b-2796-4fd0-a73f-93c69dcbf1ee tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] 10.222.0.82 "GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70" status: 200 len: 1567 microversion: 2.1 time: 0.149813 Jan 18 16:36:36.653179 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 424/837] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:36:36 2022] GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:36:36.891907 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-3931e86a-bad9-48a9-8357-171532efa0ae tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:36:36.892519 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-3931e86a-bad9-48a9-8357-171532efa0ae tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:36.899174 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3931e86a-bad9-48a9-8357-171532efa0ae tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:36.899609 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3931e86a-bad9-48a9-8357-171532efa0ae tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:36.900368 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3931e86a-bad9-48a9-8357-171532efa0ae tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:36.900793 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3931e86a-bad9-48a9-8357-171532efa0ae tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:37.030688 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-3931e86a-bad9-48a9-8357-171532efa0ae tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:37.038340 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-3931e86a-bad9-48a9-8357-171532efa0ae tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:37.040374 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-3931e86a-bad9-48a9-8357-171532efa0ae tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:37.041533 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-3931e86a-bad9-48a9-8357-171532efa0ae tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc" status: 200 len: 1732 microversion: 2.20 time: 0.153419 Jan 18 16:36:37.042096 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 414/838] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:36:36 2022] GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:36:37.486040 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [req-da286e15-9c03-4c91-8655-2fa4eb6daa39 req-ae662052-e4f0-4f23-ad79-85a28084d823 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d44a3a6-2027-437a-86a6-a826f997f8fc", "name": "network-vif-plugged", "status": "completed", "tag": "3214e15a-2bf8-4e9c-b215-8b914b1912ec"}]} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:36:37.487612 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:36:37.487612 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: warnings.warn(msg) Jan 18 16:36:37.495629 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-da286e15-9c03-4c91-8655-2fa4eb6daa39 req-ae662052-e4f0-4f23-ad79-85a28084d823 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:37.496073 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-da286e15-9c03-4c91-8655-2fa4eb6daa39 req-ae662052-e4f0-4f23-ad79-85a28084d823 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:37.506928 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.compute.server_external_events [req-da286e15-9c03-4c91-8655-2fa4eb6daa39 req-ae662052-e4f0-4f23-ad79-85a28084d823 service nova] Creating event network-vif-plugged:3214e15a-2bf8-4e9c-b215-8b914b1912ec for instance 0d44a3a6-2027-437a-86a6-a826f997f8fc on hv-cinder-78836 Jan 18 16:36:37.513428 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [req-da286e15-9c03-4c91-8655-2fa4eb6daa39 req-ae662052-e4f0-4f23-ad79-85a28084d823 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030845 Jan 18 16:36:37.514059 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 425/839] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:36:37.669375 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-7169658d-52a6-4ceb-9fee-f541e4bebeab tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:36:37.669979 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-7169658d-52a6-4ceb-9fee-f541e4bebeab tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] [instance: d5f46b70-ff39-46b9-912c-206b0683ed70] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:37.675786 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7169658d-52a6-4ceb-9fee-f541e4bebeab tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:37.676523 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7169658d-52a6-4ceb-9fee-f541e4bebeab tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:37.677597 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7169658d-52a6-4ceb-9fee-f541e4bebeab tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:37.678220 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7169658d-52a6-4ceb-9fee-f541e4bebeab tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:37.827573 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-7169658d-52a6-4ceb-9fee-f541e4bebeab tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2d1245fe3f4bf596e1c0f6978e34bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b7bab53ef4d6e869362551b3cfb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:37.836258 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-7169658d-52a6-4ceb-9fee-f541e4bebeab tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] 10.222.0.82 "GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70" status: 200 len: 1567 microversion: 2.1 time: 0.170208 Jan 18 16:36:37.836841 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 415/840] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:36:37 2022] GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:36:38.060707 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-6fdf6126-8254-4753-a53f-998b2f7e73e7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:36:38.061350 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-6fdf6126-8254-4753-a53f-998b2f7e73e7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:38.068047 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6fdf6126-8254-4753-a53f-998b2f7e73e7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:38.068494 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6fdf6126-8254-4753-a53f-998b2f7e73e7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:38.069291 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6fdf6126-8254-4753-a53f-998b2f7e73e7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:38.069783 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6fdf6126-8254-4753-a53f-998b2f7e73e7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:38.212454 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-6fdf6126-8254-4753-a53f-998b2f7e73e7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:38.221385 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-6fdf6126-8254-4753-a53f-998b2f7e73e7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:38.222981 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-6fdf6126-8254-4753-a53f-998b2f7e73e7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:38.224379 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-6fdf6126-8254-4753-a53f-998b2f7e73e7 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc" status: 200 len: 1732 microversion: 2.20 time: 0.167856 Jan 18 16:36:38.225058 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 426/841] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:36:38 2022] GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:36:38.854295 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-9534b52a-e7ec-4882-b755-23eeb49406e7 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:36:38.854847 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-9534b52a-e7ec-4882-b755-23eeb49406e7 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] [instance: d5f46b70-ff39-46b9-912c-206b0683ed70] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:38.861704 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-9534b52a-e7ec-4882-b755-23eeb49406e7 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:38.862202 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-9534b52a-e7ec-4882-b755-23eeb49406e7 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:38.863052 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-9534b52a-e7ec-4882-b755-23eeb49406e7 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:38.863495 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-9534b52a-e7ec-4882-b755-23eeb49406e7 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:39.004138 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-9534b52a-e7ec-4882-b755-23eeb49406e7 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2d1245fe3f4bf596e1c0f6978e34bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b7bab53ef4d6e869362551b3cfb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:39.011607 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-9534b52a-e7ec-4882-b755-23eeb49406e7 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] 10.222.0.82 "GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70" status: 200 len: 1567 microversion: 2.1 time: 0.162285 Jan 18 16:36:39.012181 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 416/842] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:36:38 2022] GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:36:39.246187 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-dcdffdea-b16b-4307-8693-cd6f42bfeee5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:36:39.246802 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-dcdffdea-b16b-4307-8693-cd6f42bfeee5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:39.252889 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-dcdffdea-b16b-4307-8693-cd6f42bfeee5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:39.253361 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-dcdffdea-b16b-4307-8693-cd6f42bfeee5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:39.254149 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-dcdffdea-b16b-4307-8693-cd6f42bfeee5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:39.254583 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-dcdffdea-b16b-4307-8693-cd6f42bfeee5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:39.392390 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-dcdffdea-b16b-4307-8693-cd6f42bfeee5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:39.400815 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-dcdffdea-b16b-4307-8693-cd6f42bfeee5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:39.402463 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-dcdffdea-b16b-4307-8693-cd6f42bfeee5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:39.403758 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-dcdffdea-b16b-4307-8693-cd6f42bfeee5 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc" status: 200 len: 1732 microversion: 2.20 time: 0.163857 Jan 18 16:36:39.404402 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 427/843] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:36:39 2022] GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:36:40.029325 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-6a005d90-b88c-4ae1-8f57-be0ba669cfca tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:36:40.029959 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-6a005d90-b88c-4ae1-8f57-be0ba669cfca tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] [instance: d5f46b70-ff39-46b9-912c-206b0683ed70] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:40.036089 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-6a005d90-b88c-4ae1-8f57-be0ba669cfca tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:40.036532 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-6a005d90-b88c-4ae1-8f57-be0ba669cfca tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:40.037333 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-6a005d90-b88c-4ae1-8f57-be0ba669cfca tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:40.037764 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-6a005d90-b88c-4ae1-8f57-be0ba669cfca tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:40.167861 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-6a005d90-b88c-4ae1-8f57-be0ba669cfca tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2d1245fe3f4bf596e1c0f6978e34bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b7bab53ef4d6e869362551b3cfb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:40.176441 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-6a005d90-b88c-4ae1-8f57-be0ba669cfca tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] 10.222.0.82 "GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70" status: 200 len: 1567 microversion: 2.1 time: 0.150740 Jan 18 16:36:40.177050 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 417/844] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:36:40 2022] GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:36:40.421884 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-431aeb69-9497-49f6-9f48-86adb2f48271 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:36:40.422495 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-431aeb69-9497-49f6-9f48-86adb2f48271 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:40.429672 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-431aeb69-9497-49f6-9f48-86adb2f48271 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:40.430125 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-431aeb69-9497-49f6-9f48-86adb2f48271 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:40.430906 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-431aeb69-9497-49f6-9f48-86adb2f48271 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:40.431337 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-431aeb69-9497-49f6-9f48-86adb2f48271 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:40.560068 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-431aeb69-9497-49f6-9f48-86adb2f48271 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:40.568038 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-431aeb69-9497-49f6-9f48-86adb2f48271 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:40.570241 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-431aeb69-9497-49f6-9f48-86adb2f48271 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:40.571486 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-431aeb69-9497-49f6-9f48-86adb2f48271 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc" status: 200 len: 1719 microversion: 2.20 time: 0.153397 Jan 18 16:36:40.572045 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 428/845] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:36:40 2022] GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc => generated 1719 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:36:41.193122 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-90b6c3dc-4674-44b1-8a41-9f71f30dc8bf tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:36:41.193737 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-90b6c3dc-4674-44b1-8a41-9f71f30dc8bf tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] [instance: d5f46b70-ff39-46b9-912c-206b0683ed70] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:41.200029 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-90b6c3dc-4674-44b1-8a41-9f71f30dc8bf tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:41.200468 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-90b6c3dc-4674-44b1-8a41-9f71f30dc8bf tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:41.201267 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-90b6c3dc-4674-44b1-8a41-9f71f30dc8bf tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:41.201694 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-90b6c3dc-4674-44b1-8a41-9f71f30dc8bf tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:41.334070 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-90b6c3dc-4674-44b1-8a41-9f71f30dc8bf tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2d1245fe3f4bf596e1c0f6978e34bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b7bab53ef4d6e869362551b3cfb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:41.342263 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-90b6c3dc-4674-44b1-8a41-9f71f30dc8bf tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] 10.222.0.82 "GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70" status: 200 len: 1567 microversion: 2.1 time: 0.153043 Jan 18 16:36:41.342827 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 418/846] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:36:41 2022] GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:36:42.359758 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-9a3bb18a-3dda-46f2-8899-c97a0f0e906e tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:36:42.360362 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-9a3bb18a-3dda-46f2-8899-c97a0f0e906e tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] [instance: d5f46b70-ff39-46b9-912c-206b0683ed70] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:42.366742 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-9a3bb18a-3dda-46f2-8899-c97a0f0e906e tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:42.367187 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-9a3bb18a-3dda-46f2-8899-c97a0f0e906e tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:42.367961 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-9a3bb18a-3dda-46f2-8899-c97a0f0e906e tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:42.368392 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-9a3bb18a-3dda-46f2-8899-c97a0f0e906e tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:42.499139 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-9a3bb18a-3dda-46f2-8899-c97a0f0e906e tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2d1245fe3f4bf596e1c0f6978e34bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b7bab53ef4d6e869362551b3cfb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:42.506392 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-9a3bb18a-3dda-46f2-8899-c97a0f0e906e tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] 10.222.0.82 "GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70" status: 200 len: 1567 microversion: 2.1 time: 0.150314 Jan 18 16:36:42.507518 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 429/847] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:36:42 2022] GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:36:43.524521 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-1343cc53-def8-4859-9254-0617f49e5b1c tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:36:43.525299 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-1343cc53-def8-4859-9254-0617f49e5b1c tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] [instance: d5f46b70-ff39-46b9-912c-206b0683ed70] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:43.531275 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1343cc53-def8-4859-9254-0617f49e5b1c tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:43.531713 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1343cc53-def8-4859-9254-0617f49e5b1c tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:43.532532 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1343cc53-def8-4859-9254-0617f49e5b1c tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:43.532977 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1343cc53-def8-4859-9254-0617f49e5b1c tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:43.768510 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-1343cc53-def8-4859-9254-0617f49e5b1c tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2d1245fe3f4bf596e1c0f6978e34bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b7bab53ef4d6e869362551b3cfb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:43.776678 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-1343cc53-def8-4859-9254-0617f49e5b1c tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] 10.222.0.82 "GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70" status: 200 len: 1567 microversion: 2.1 time: 0.256445 Jan 18 16:36:43.777223 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 419/848] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:36:43 2022] GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70 => generated 1567 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:36:44.794006 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-7203a749-9546-40cd-b273-3631cc89b834 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:36:44.794636 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-7203a749-9546-40cd-b273-3631cc89b834 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] [instance: d5f46b70-ff39-46b9-912c-206b0683ed70] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:44.800799 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7203a749-9546-40cd-b273-3631cc89b834 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:44.801270 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7203a749-9546-40cd-b273-3631cc89b834 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:44.802033 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7203a749-9546-40cd-b273-3631cc89b834 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:44.802462 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7203a749-9546-40cd-b273-3631cc89b834 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:44.932100 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-7203a749-9546-40cd-b273-3631cc89b834 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2d1245fe3f4bf596e1c0f6978e34bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b7bab53ef4d6e869362551b3cfb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:44.939317 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-7203a749-9546-40cd-b273-3631cc89b834 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] 10.222.0.82 "GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70" status: 200 len: 1567 microversion: 2.1 time: 0.149027 Jan 18 16:36:44.939893 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 430/849] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:36:44 2022] GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:36:45.956194 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-3d6e6057-b03d-4732-b3c6-8f0a3cec5108 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:36:45.956788 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-3d6e6057-b03d-4732-b3c6-8f0a3cec5108 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] [instance: d5f46b70-ff39-46b9-912c-206b0683ed70] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:45.963037 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3d6e6057-b03d-4732-b3c6-8f0a3cec5108 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:45.963477 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3d6e6057-b03d-4732-b3c6-8f0a3cec5108 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:45.964244 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3d6e6057-b03d-4732-b3c6-8f0a3cec5108 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:45.964672 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3d6e6057-b03d-4732-b3c6-8f0a3cec5108 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:46.105011 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-3d6e6057-b03d-4732-b3c6-8f0a3cec5108 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2d1245fe3f4bf596e1c0f6978e34bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b7bab53ef4d6e869362551b3cfb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:46.112429 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-3d6e6057-b03d-4732-b3c6-8f0a3cec5108 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] 10.222.0.82 "GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70" status: 200 len: 1567 microversion: 2.1 time: 0.159843 Jan 18 16:36:46.113023 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 420/850] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:36:45 2022] GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:36:47.129941 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-999df27f-51a1-4f7d-8ed0-74111994770a tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:36:47.130555 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-999df27f-51a1-4f7d-8ed0-74111994770a tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] [instance: d5f46b70-ff39-46b9-912c-206b0683ed70] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:47.137703 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-999df27f-51a1-4f7d-8ed0-74111994770a tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:47.138151 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-999df27f-51a1-4f7d-8ed0-74111994770a tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:47.138928 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-999df27f-51a1-4f7d-8ed0-74111994770a tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:47.139365 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-999df27f-51a1-4f7d-8ed0-74111994770a tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:47.268024 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-999df27f-51a1-4f7d-8ed0-74111994770a tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2d1245fe3f4bf596e1c0f6978e34bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b7bab53ef4d6e869362551b3cfb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:47.275809 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-999df27f-51a1-4f7d-8ed0-74111994770a tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] 10.222.0.82 "GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70" status: 200 len: 1508 microversion: 2.1 time: 0.149781 Jan 18 16:36:47.276373 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 431/851] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:36:47 2022] GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:36:47.292038 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-c3b0e906-59fc-4944-9952-defc96daa16c tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:36:47.292606 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-c3b0e906-59fc-4944-9952-defc96daa16c tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] [instance: d5f46b70-ff39-46b9-912c-206b0683ed70] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:47.298589 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c3b0e906-59fc-4944-9952-defc96daa16c tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:47.299044 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c3b0e906-59fc-4944-9952-defc96daa16c tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:47.299821 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c3b0e906-59fc-4944-9952-defc96daa16c tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:47.300280 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c3b0e906-59fc-4944-9952-defc96daa16c tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:47.373968 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-c3b0e906-59fc-4944-9952-defc96daa16c tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] 10.222.0.82 "POST /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70/action" status: 202 len: 0 microversion: 2.1 time: 0.086042 Jan 18 16:36:47.374566 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 421/852] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:36:47 2022] POST /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:36:47.383113 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-232f0299-f925-4a1f-811d-f02007049c78 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:36:47.383635 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-232f0299-f925-4a1f-811d-f02007049c78 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] [instance: d5f46b70-ff39-46b9-912c-206b0683ed70] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:47.389604 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-232f0299-f925-4a1f-811d-f02007049c78 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:47.390058 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-232f0299-f925-4a1f-811d-f02007049c78 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:47.390842 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-232f0299-f925-4a1f-811d-f02007049c78 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:47.391277 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-232f0299-f925-4a1f-811d-f02007049c78 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:47.528782 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-232f0299-f925-4a1f-811d-f02007049c78 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2d1245fe3f4bf596e1c0f6978e34bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b7bab53ef4d6e869362551b3cfb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:47.536209 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-232f0299-f925-4a1f-811d-f02007049c78 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] 10.222.0.82 "GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70" status: 200 len: 1516 microversion: 2.1 time: 0.157507 Jan 18 16:36:47.536810 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 432/853] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:36:47 2022] GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:36:48.554484 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-eafaf6a6-2382-4c03-b5f3-380592317e9a tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:36:48.555134 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-eafaf6a6-2382-4c03-b5f3-380592317e9a tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] [instance: d5f46b70-ff39-46b9-912c-206b0683ed70] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:48.561734 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-eafaf6a6-2382-4c03-b5f3-380592317e9a tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:48.562190 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-eafaf6a6-2382-4c03-b5f3-380592317e9a tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:48.563060 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-eafaf6a6-2382-4c03-b5f3-380592317e9a tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:48.563498 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-eafaf6a6-2382-4c03-b5f3-380592317e9a tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:48.698306 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-eafaf6a6-2382-4c03-b5f3-380592317e9a tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2d1245fe3f4bf596e1c0f6978e34bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b7bab53ef4d6e869362551b3cfb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:48.709136 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-eafaf6a6-2382-4c03-b5f3-380592317e9a tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] 10.222.0.82 "GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70" status: 200 len: 1574 microversion: 2.1 time: 0.159144 Jan 18 16:36:48.710390 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 422/854] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:36:48 2022] GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70 => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:36:49.518412 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [req-69fa9edc-d90d-42a1-9235-b3aa5d927a5e req-7e0503af-19bb-4560-bb58-a5d4f4e98250 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5f46b70-ff39-46b9-912c-206b0683ed70", "name": "network-vif-unplugged", "status": "completed", "tag": "66167132-c1b5-4c9b-983f-cc21fd90ca2e"}]} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:36:49.519928 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:36:49.519928 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: warnings.warn(msg) Jan 18 16:36:49.528640 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-69fa9edc-d90d-42a1-9235-b3aa5d927a5e req-7e0503af-19bb-4560-bb58-a5d4f4e98250 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:49.529128 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-69fa9edc-d90d-42a1-9235-b3aa5d927a5e req-7e0503af-19bb-4560-bb58-a5d4f4e98250 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:49.540080 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.compute.server_external_events [req-69fa9edc-d90d-42a1-9235-b3aa5d927a5e req-7e0503af-19bb-4560-bb58-a5d4f4e98250 service nova] Creating event network-vif-unplugged:66167132-c1b5-4c9b-983f-cc21fd90ca2e for instance d5f46b70-ff39-46b9-912c-206b0683ed70 on hv-cinder-78836 Jan 18 16:36:49.545050 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [req-69fa9edc-d90d-42a1-9235-b3aa5d927a5e req-7e0503af-19bb-4560-bb58-a5d4f4e98250 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030261 Jan 18 16:36:49.545634 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 433/855] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:36:49.727897 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-7497aab0-8335-4cec-9709-4d1f59afded9 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:36:49.728486 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-7497aab0-8335-4cec-9709-4d1f59afded9 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] [instance: d5f46b70-ff39-46b9-912c-206b0683ed70] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:49.734714 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7497aab0-8335-4cec-9709-4d1f59afded9 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:49.735173 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7497aab0-8335-4cec-9709-4d1f59afded9 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:49.735946 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7497aab0-8335-4cec-9709-4d1f59afded9 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:49.736359 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7497aab0-8335-4cec-9709-4d1f59afded9 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:49.865765 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-7497aab0-8335-4cec-9709-4d1f59afded9 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2d1245fe3f4bf596e1c0f6978e34bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b7bab53ef4d6e869362551b3cfb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:49.873623 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-7497aab0-8335-4cec-9709-4d1f59afded9 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] 10.222.0.82 "GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70" status: 200 len: 1574 microversion: 2.1 time: 0.150496 Jan 18 16:36:49.874181 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 423/856] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:36:49 2022] GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70 => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:36:50.891953 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-4806ce99-7bc7-41e9-a4fb-c627e0f87489 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:36:50.892646 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-4806ce99-7bc7-41e9-a4fb-c627e0f87489 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] [instance: d5f46b70-ff39-46b9-912c-206b0683ed70] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:50.900150 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4806ce99-7bc7-41e9-a4fb-c627e0f87489 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:50.900601 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4806ce99-7bc7-41e9-a4fb-c627e0f87489 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:50.901421 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4806ce99-7bc7-41e9-a4fb-c627e0f87489 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:50.901863 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4806ce99-7bc7-41e9-a4fb-c627e0f87489 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:51.041397 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-4806ce99-7bc7-41e9-a4fb-c627e0f87489 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2d1245fe3f4bf596e1c0f6978e34bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b7bab53ef4d6e869362551b3cfb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:51.048614 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-4806ce99-7bc7-41e9-a4fb-c627e0f87489 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] 10.222.0.82 "GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70" status: 200 len: 1574 microversion: 2.1 time: 0.160778 Jan 18 16:36:51.049272 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 434/857] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:36:50 2022] GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70 => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:36:52.065412 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-10e9dd79-88c7-4475-9714-f922b47afb43 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:36:52.066307 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-10e9dd79-88c7-4475-9714-f922b47afb43 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] [instance: d5f46b70-ff39-46b9-912c-206b0683ed70] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:52.072593 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-10e9dd79-88c7-4475-9714-f922b47afb43 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:52.073069 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-10e9dd79-88c7-4475-9714-f922b47afb43 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:52.073837 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-10e9dd79-88c7-4475-9714-f922b47afb43 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:52.074265 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-10e9dd79-88c7-4475-9714-f922b47afb43 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:52.201858 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-10e9dd79-88c7-4475-9714-f922b47afb43 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2d1245fe3f4bf596e1c0f6978e34bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b7bab53ef4d6e869362551b3cfb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:52.209116 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-10e9dd79-88c7-4475-9714-f922b47afb43 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] 10.222.0.82 "GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70" status: 200 len: 1574 microversion: 2.1 time: 0.147357 Jan 18 16:36:52.209693 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 424/858] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:36:52 2022] GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70 => generated 1574 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:36:53.227308 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-669dbf30-5efe-4fad-81a6-f78b91771bd1 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:36:53.227935 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-669dbf30-5efe-4fad-81a6-f78b91771bd1 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] [instance: d5f46b70-ff39-46b9-912c-206b0683ed70] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:53.234204 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-669dbf30-5efe-4fad-81a6-f78b91771bd1 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:53.234656 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-669dbf30-5efe-4fad-81a6-f78b91771bd1 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:53.235448 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-669dbf30-5efe-4fad-81a6-f78b91771bd1 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:53.235884 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-669dbf30-5efe-4fad-81a6-f78b91771bd1 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:53.380045 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-669dbf30-5efe-4fad-81a6-f78b91771bd1 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2d1245fe3f4bf596e1c0f6978e34bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b7bab53ef4d6e869362551b3cfb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:53.388442 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-669dbf30-5efe-4fad-81a6-f78b91771bd1 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] 10.222.0.82 "GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70" status: 200 len: 1574 microversion: 2.1 time: 0.165739 Jan 18 16:36:53.389033 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 435/859] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:36:53 2022] GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70 => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:36:54.405776 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-56fa4bd1-6b26-4313-a9b3-a3d74333b935 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:36:54.406349 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-56fa4bd1-6b26-4313-a9b3-a3d74333b935 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] [instance: d5f46b70-ff39-46b9-912c-206b0683ed70] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:54.412546 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-56fa4bd1-6b26-4313-a9b3-a3d74333b935 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:54.413613 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-56fa4bd1-6b26-4313-a9b3-a3d74333b935 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:54.414642 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-56fa4bd1-6b26-4313-a9b3-a3d74333b935 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:54.415069 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-56fa4bd1-6b26-4313-a9b3-a3d74333b935 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:54.545020 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-56fa4bd1-6b26-4313-a9b3-a3d74333b935 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2d1245fe3f4bf596e1c0f6978e34bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b7bab53ef4d6e869362551b3cfb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:54.552222 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-56fa4bd1-6b26-4313-a9b3-a3d74333b935 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] 10.222.0.82 "GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70" status: 200 len: 1574 microversion: 2.1 time: 0.150100 Jan 18 16:36:54.552782 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 425/860] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:36:54 2022] GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70 => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:36:55.571426 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-335672d9-5409-4eb6-9be7-07b2b7cd5a05 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:36:55.571954 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-335672d9-5409-4eb6-9be7-07b2b7cd5a05 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] [instance: d5f46b70-ff39-46b9-912c-206b0683ed70] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:55.578706 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-335672d9-5409-4eb6-9be7-07b2b7cd5a05 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:55.579160 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-335672d9-5409-4eb6-9be7-07b2b7cd5a05 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:55.579953 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-335672d9-5409-4eb6-9be7-07b2b7cd5a05 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:55.580387 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-335672d9-5409-4eb6-9be7-07b2b7cd5a05 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:55.747834 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-335672d9-5409-4eb6-9be7-07b2b7cd5a05 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2d1245fe3f4bf596e1c0f6978e34bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b7bab53ef4d6e869362551b3cfb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:55.755269 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-335672d9-5409-4eb6-9be7-07b2b7cd5a05 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] 10.222.0.82 "GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70" status: 200 len: 1574 microversion: 2.1 time: 0.188730 Jan 18 16:36:55.755840 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 436/861] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:36:55 2022] GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70 => generated 1574 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:36:56.771984 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-0c99a35d-665b-4bf1-a760-843d36ff69a2 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:36:56.772663 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-0c99a35d-665b-4bf1-a760-843d36ff69a2 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] [instance: d5f46b70-ff39-46b9-912c-206b0683ed70] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:56.779959 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0c99a35d-665b-4bf1-a760-843d36ff69a2 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:56.780403 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0c99a35d-665b-4bf1-a760-843d36ff69a2 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:56.781373 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0c99a35d-665b-4bf1-a760-843d36ff69a2 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:56.781801 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0c99a35d-665b-4bf1-a760-843d36ff69a2 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:56.915610 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-0c99a35d-665b-4bf1-a760-843d36ff69a2 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2d1245fe3f4bf596e1c0f6978e34bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b7bab53ef4d6e869362551b3cfb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:56.922894 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-0c99a35d-665b-4bf1-a760-843d36ff69a2 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] 10.222.0.82 "GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70" status: 200 len: 1574 microversion: 2.1 time: 0.154606 Jan 18 16:36:56.923456 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 426/862] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:36:56 2022] GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:36:57.939324 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-63bb5397-67db-49dc-9685-8548f82a675b tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:36:57.939962 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-63bb5397-67db-49dc-9685-8548f82a675b tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] [instance: d5f46b70-ff39-46b9-912c-206b0683ed70] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:36:57.947215 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-63bb5397-67db-49dc-9685-8548f82a675b tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:57.947665 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-63bb5397-67db-49dc-9685-8548f82a675b tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:57.948444 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-63bb5397-67db-49dc-9685-8548f82a675b tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:57.948876 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-63bb5397-67db-49dc-9685-8548f82a675b tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:58.081842 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-63bb5397-67db-49dc-9685-8548f82a675b tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2d1245fe3f4bf596e1c0f6978e34bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b7bab53ef4d6e869362551b3cfb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:36:58.089341 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-63bb5397-67db-49dc-9685-8548f82a675b tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] 10.222.0.82 "GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70" status: 200 len: 1561 microversion: 2.1 time: 0.153615 Jan 18 16:36:58.089903 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 437/863] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:36:57 2022] GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:36:59.580841 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [req-80eb0de3-9860-4100-b3fa-b299892a4a32 req-5df9d5cf-c9e1-4617-986a-5c2f8e32bf55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5f46b70-ff39-46b9-912c-206b0683ed70", "name": "network-vif-plugged", "status": "completed", "tag": "66167132-c1b5-4c9b-983f-cc21fd90ca2e"}]} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:36:59.582473 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:36:59.582473 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: warnings.warn(msg) Jan 18 16:36:59.590318 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-80eb0de3-9860-4100-b3fa-b299892a4a32 req-5df9d5cf-c9e1-4617-986a-5c2f8e32bf55 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:36:59.590762 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-80eb0de3-9860-4100-b3fa-b299892a4a32 req-5df9d5cf-c9e1-4617-986a-5c2f8e32bf55 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:36:59.603446 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.compute.server_external_events [req-80eb0de3-9860-4100-b3fa-b299892a4a32 req-5df9d5cf-c9e1-4617-986a-5c2f8e32bf55 service nova] Creating event network-vif-plugged:66167132-c1b5-4c9b-983f-cc21fd90ca2e for instance d5f46b70-ff39-46b9-912c-206b0683ed70 on hv-cinder-78836 Jan 18 16:36:59.608430 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [req-80eb0de3-9860-4100-b3fa-b299892a4a32 req-5df9d5cf-c9e1-4617-986a-5c2f8e32bf55 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031215 Jan 18 16:36:59.609146 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 427/864] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:36:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:37:13.955379 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-78fad739-1bb7-4832-ad61-c21d770f78dd tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:37:13.956412 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-78fad739-1bb7-4832-ad61-c21d770f78dd tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:37:13.964212 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-78fad739-1bb7-4832-ad61-c21d770f78dd tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:13.964662 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-78fad739-1bb7-4832-ad61-c21d770f78dd tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:13.965489 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-78fad739-1bb7-4832-ad61-c21d770f78dd tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:13.965925 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-78fad739-1bb7-4832-ad61-c21d770f78dd tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:13.997513 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-78fad739-1bb7-4832-ad61-c21d770f78dd tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045871 Jan 18 16:37:13.998097 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 438/865] 10.222.0.82 () {60 vars in 1342 bytes} [Tue Jan 18 16:37:13 2022] GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:37:14.073743 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-7847809e-9510-4a04-895e-2906f86f04fa tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:37:14.074416 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-7847809e-9510-4a04-895e-2906f86f04fa tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:37:14.081166 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7847809e-9510-4a04-895e-2906f86f04fa tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:14.081615 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7847809e-9510-4a04-895e-2906f86f04fa tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:14.082405 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7847809e-9510-4a04-895e-2906f86f04fa tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:14.082842 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7847809e-9510-4a04-895e-2906f86f04fa tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:14.108189 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-7847809e-9510-4a04-895e-2906f86f04fa tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Going to try to terminate instance {{(pid=116368) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 18 16:37:14.194667 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-7847809e-9510-4a04-895e-2906f86f04fa tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "DELETE /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc" status: 204 len: 0 microversion: 2.20 time: 0.125067 Jan 18 16:37:14.195601 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 428/866] 10.222.0.82 () {60 vars in 1279 bytes} [Tue Jan 18 16:37:14 2022] DELETE /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 18 16:37:14.203623 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-0948ea6a-4eba-4a45-a1fa-78f30696b26f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:37:14.204229 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-0948ea6a-4eba-4a45-a1fa-78f30696b26f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:37:14.210269 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0948ea6a-4eba-4a45-a1fa-78f30696b26f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:14.210799 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0948ea6a-4eba-4a45-a1fa-78f30696b26f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:14.211497 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0948ea6a-4eba-4a45-a1fa-78f30696b26f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:14.211978 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0948ea6a-4eba-4a45-a1fa-78f30696b26f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:14.351175 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-0948ea6a-4eba-4a45-a1fa-78f30696b26f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:37:14.359051 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-0948ea6a-4eba-4a45-a1fa-78f30696b26f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:37:14.360545 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-0948ea6a-4eba-4a45-a1fa-78f30696b26f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:37:14.361750 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-0948ea6a-4eba-4a45-a1fa-78f30696b26f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc" status: 200 len: 1725 microversion: 2.20 time: 0.161952 Jan 18 16:37:14.362314 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 439/867] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:37:14 2022] GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 16:37:15.380949 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-398e9fd4-a557-4a35-afaf-3be6eb9737b0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:37:15.381642 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-398e9fd4-a557-4a35-afaf-3be6eb9737b0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:37:15.387781 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-398e9fd4-a557-4a35-afaf-3be6eb9737b0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:15.388227 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-398e9fd4-a557-4a35-afaf-3be6eb9737b0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:15.389021 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-398e9fd4-a557-4a35-afaf-3be6eb9737b0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:15.389450 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-398e9fd4-a557-4a35-afaf-3be6eb9737b0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:15.525792 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-398e9fd4-a557-4a35-afaf-3be6eb9737b0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:37:15.533769 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-398e9fd4-a557-4a35-afaf-3be6eb9737b0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:37:15.535271 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-398e9fd4-a557-4a35-afaf-3be6eb9737b0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:37:15.536435 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-398e9fd4-a557-4a35-afaf-3be6eb9737b0 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc" status: 200 len: 1725 microversion: 2.20 time: 0.159632 Jan 18 16:37:15.537022 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 429/868] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:37:15 2022] GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:37:16.555669 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-245578aa-ddd9-404b-9580-8d04f7ccd86f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:37:16.557000 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-245578aa-ddd9-404b-9580-8d04f7ccd86f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:37:16.563803 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-245578aa-ddd9-404b-9580-8d04f7ccd86f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:16.564245 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-245578aa-ddd9-404b-9580-8d04f7ccd86f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:16.565063 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-245578aa-ddd9-404b-9580-8d04f7ccd86f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:16.565494 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-245578aa-ddd9-404b-9580-8d04f7ccd86f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:16.733719 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-245578aa-ddd9-404b-9580-8d04f7ccd86f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:37:16.742802 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-245578aa-ddd9-404b-9580-8d04f7ccd86f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:37:16.744297 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-245578aa-ddd9-404b-9580-8d04f7ccd86f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996b56c77ddc470e9ed536ae6936acbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec6b09b84c64d969dd91ab88dc56e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:37:16.745512 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-245578aa-ddd9-404b-9580-8d04f7ccd86f tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc" status: 200 len: 1658 microversion: 2.20 time: 0.194260 Jan 18 16:37:16.746575 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 440/869] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:37:16 2022] GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc => generated 1658 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 16:37:16.923446 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [req-a51854d8-4a00-4ea4-869f-3d16ce83ad0e req-495ae870-fd3d-46fc-a2f9-d12f570de62c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d44a3a6-2027-437a-86a6-a826f997f8fc", "name": "network-vif-deleted", "tag": "3214e15a-2bf8-4e9c-b215-8b914b1912ec"}]} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:37:16.925117 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:37:16.925117 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: warnings.warn(msg) Jan 18 16:37:16.933679 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-a51854d8-4a00-4ea4-869f-3d16ce83ad0e req-495ae870-fd3d-46fc-a2f9-d12f570de62c service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:16.934667 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-a51854d8-4a00-4ea4-869f-3d16ce83ad0e req-495ae870-fd3d-46fc-a2f9-d12f570de62c service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:16.947180 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.compute.server_external_events [req-a51854d8-4a00-4ea4-869f-3d16ce83ad0e req-495ae870-fd3d-46fc-a2f9-d12f570de62c service nova] Creating event network-vif-deleted:3214e15a-2bf8-4e9c-b215-8b914b1912ec for instance 0d44a3a6-2027-437a-86a6-a826f997f8fc on hv-cinder-78836 Jan 18 16:37:16.953363 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [req-a51854d8-4a00-4ea4-869f-3d16ce83ad0e req-495ae870-fd3d-46fc-a2f9-d12f570de62c service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033721 Jan 18 16:37:16.954150 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 430/870] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:37:17.763884 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-b720943e-ca78-44e6-bb22-cdf3b9d2a75b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:37:17.764516 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-b720943e-ca78-44e6-bb22-cdf3b9d2a75b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:37:17.771087 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-b720943e-ca78-44e6-bb22-cdf3b9d2a75b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:17.772191 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-b720943e-ca78-44e6-bb22-cdf3b9d2a75b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:17.774584 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-b720943e-ca78-44e6-bb22-cdf3b9d2a75b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:17.775030 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-b720943e-ca78-44e6-bb22-cdf3b9d2a75b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:17.790390 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.wsgi [None req-b720943e-ca78-44e6-bb22-cdf3b9d2a75b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] HTTP exception thrown: Instance 0d44a3a6-2027-437a-86a6-a826f997f8fc could not be found. Jan 18 16:37:17.790979 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-b720943e-ca78-44e6-bb22-cdf3b9d2a75b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Returning 404 to user: Instance 0d44a3a6-2027-437a-86a6-a826f997f8fc could not be found. {{(pid=116367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 16:37:17.791812 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-b720943e-ca78-44e6-bb22-cdf3b9d2a75b tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc" status: 404 len: 111 microversion: 2.20 time: 0.031795 Jan 18 16:37:17.792364 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 441/871] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:37:17 2022] GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 18 16:37:17.801069 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-fd6c027e-9ab7-462c-9433-f1bf3cc0cb4c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '.version_select at 0x7f33a4954b80>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:37:17.824746 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-fd6c027e-9ab7-462c-9433-f1bf3cc0cb4c tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1190613664" status: 204 len: 0 microversion: 2.20 time: 0.027659 Jan 18 16:37:17.825421 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 431/872] 10.222.0.82 () {60 vars in 1261 bytes} [Tue Jan 18 16:37:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1190613664 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 18 16:37:19.677411 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-47fc807e-1c53-4054-b8c8-bab28e0335f9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:37:19.678432 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-47fc807e-1c53-4054-b8c8-bab28e0335f9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:37:19.685650 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-47fc807e-1c53-4054-b8c8-bab28e0335f9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:19.686101 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-47fc807e-1c53-4054-b8c8-bab28e0335f9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:19.686885 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-47fc807e-1c53-4054-b8c8-bab28e0335f9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:19.687436 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-47fc807e-1c53-4054-b8c8-bab28e0335f9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:19.701959 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.wsgi [None req-47fc807e-1c53-4054-b8c8-bab28e0335f9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] HTTP exception thrown: Instance 0d44a3a6-2027-437a-86a6-a826f997f8fc could not be found. Jan 18 16:37:19.702548 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-47fc807e-1c53-4054-b8c8-bab28e0335f9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Returning 404 to user: Instance 0d44a3a6-2027-437a-86a6-a826f997f8fc could not be found. {{(pid=116367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 16:37:19.703367 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-47fc807e-1c53-4054-b8c8-bab28e0335f9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "DELETE /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc" status: 404 len: 111 microversion: 2.20 time: 0.029619 Jan 18 16:37:19.703890 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 442/873] 10.222.0.82 () {60 vars in 1279 bytes} [Tue Jan 18 16:37:19 2022] DELETE /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 18 16:37:19.711667 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-a609abb6-54e5-433d-b4f3-94445a864298 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:37:19.712387 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-a609abb6-54e5-433d-b4f3-94445a864298 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 0d44a3a6-2027-437a-86a6-a826f997f8fc] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:37:19.718766 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a609abb6-54e5-433d-b4f3-94445a864298 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:19.719204 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a609abb6-54e5-433d-b4f3-94445a864298 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:19.719970 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a609abb6-54e5-433d-b4f3-94445a864298 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:19.720399 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a609abb6-54e5-433d-b4f3-94445a864298 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:19.733465 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.wsgi [None req-a609abb6-54e5-433d-b4f3-94445a864298 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] HTTP exception thrown: Instance 0d44a3a6-2027-437a-86a6-a826f997f8fc could not be found. Jan 18 16:37:19.734034 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-a609abb6-54e5-433d-b4f3-94445a864298 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Returning 404 to user: Instance 0d44a3a6-2027-437a-86a6-a826f997f8fc could not be found. {{(pid=116368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 16:37:19.734826 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-a609abb6-54e5-433d-b4f3-94445a864298 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc" status: 404 len: 111 microversion: 2.20 time: 0.026974 Jan 18 16:37:19.735367 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 432/874] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:37:19 2022] GET /compute/v2.1/servers/0d44a3a6-2027-437a-86a6-a826f997f8fc => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jan 18 16:37:20.862397 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-a9be9577-fc98-47fa-b73f-2372afb30f82 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:37:20.862909 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-a9be9577-fc98-47fa-b73f-2372afb30f82 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:37:20.870179 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a9be9577-fc98-47fa-b73f-2372afb30f82 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:20.870619 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a9be9577-fc98-47fa-b73f-2372afb30f82 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:20.871387 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a9be9577-fc98-47fa-b73f-2372afb30f82 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:20.871814 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a9be9577-fc98-47fa-b73f-2372afb30f82 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:20.884911 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.wsgi [None req-a9be9577-fc98-47fa-b73f-2372afb30f82 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] HTTP exception thrown: Instance 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee could not be found. Jan 18 16:37:20.885500 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-a9be9577-fc98-47fa-b73f-2372afb30f82 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Returning 404 to user: Instance 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee could not be found. {{(pid=116367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 16:37:20.886324 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-a9be9577-fc98-47fa-b73f-2372afb30f82 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "DELETE /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 404 len: 111 microversion: 2.20 time: 0.027544 Jan 18 16:37:20.886846 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 443/875] 10.222.0.82 () {60 vars in 1279 bytes} [Tue Jan 18 16:37:20 2022] DELETE /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 18 16:37:20.894483 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-13c37dc9-b601-47ae-a96b-d5fc1302b3d9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:37:20.895081 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-13c37dc9-b601-47ae-a96b-d5fc1302b3d9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] [instance: 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:37:20.902034 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-13c37dc9-b601-47ae-a96b-d5fc1302b3d9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:20.902470 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-13c37dc9-b601-47ae-a96b-d5fc1302b3d9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:20.903237 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-13c37dc9-b601-47ae-a96b-d5fc1302b3d9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:20.903662 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-13c37dc9-b601-47ae-a96b-d5fc1302b3d9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:20.917068 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.wsgi [None req-13c37dc9-b601-47ae-a96b-d5fc1302b3d9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] HTTP exception thrown: Instance 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee could not be found. Jan 18 16:37:20.917643 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-13c37dc9-b601-47ae-a96b-d5fc1302b3d9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] Returning 404 to user: Instance 4e9ca525-aad0-4ac6-8879-2c8d0131c2ee could not be found. {{(pid=116368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 16:37:20.918447 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-13c37dc9-b601-47ae-a96b-d5fc1302b3d9 tempest-AttachVolumeShelveTestJSON-1484482555 tempest-AttachVolumeShelveTestJSON-1484482555-project] 10.222.0.82 "GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee" status: 404 len: 111 microversion: 2.20 time: 0.027601 Jan 18 16:37:20.918965 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 433/876] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Jan 18 16:37:20 2022] GET /compute/v2.1/servers/4e9ca525-aad0-4ac6-8879-2c8d0131c2ee => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 18 16:37:29.503707 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-43ee0ac0-a44f-44df-8da2-b849ff240b39 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'create', calling method: .version_select at 0x7f33a4770dc0>, body: {"keypair": {"name": "tempest-keypair-2022187801"}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:37:29.518223 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.quota [None req-43ee0ac0-a44f-44df-8da2-b849ff240b39 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Getting quotas for project 7b7c9d7399db4865a899d61aa89b988d. Resources: {'key_pairs'} {{(pid=116367) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 16:37:29.522762 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.quota [None req-43ee0ac0-a44f-44df-8da2-b849ff240b39 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Getting quotas for user 08aeeb75184240ce9c0c17fc54e6eb18 and project 7b7c9d7399db4865a899d61aa89b988d. Resources: {'key_pairs'} {{(pid=116367) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 16:37:29.889601 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.quota [None req-43ee0ac0-a44f-44df-8da2-b849ff240b39 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Getting quotas for project 7b7c9d7399db4865a899d61aa89b988d. Resources: {'key_pairs'} {{(pid=116367) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 16:37:29.894205 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.quota [None req-43ee0ac0-a44f-44df-8da2-b849ff240b39 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Getting quotas for user 08aeeb75184240ce9c0c17fc54e6eb18 and project 7b7c9d7399db4865a899d61aa89b988d. Resources: {'key_pairs'} {{(pid=116367) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 16:37:29.913516 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-43ee0ac0-a44f-44df-8da2-b849ff240b39 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.524521 Jan 18 16:37:29.914151 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 444/877] 10.222.0.82 () {60 vars in 1157 bytes} [Tue Jan 18 16:37:29 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:37:31.596642 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-15c9bdf9-610e-4048-8641-5de0cf4ab722 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1801431400", "imageRef": "900c4a9d-b6c6-451f-a509-eb4f4b49f459", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "631a6541-53f9-4654-914b-6ff69da121f2"}], "security_groups": [{"name": "tempest-securitygroup--717086283"}], "key_name": "tempest-keypair-2022187801", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:37:31.721074 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.network.neutron [None req-15c9bdf9-610e-4048-8641-5de0cf4ab722 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] validate_networks() for [('631a6541-53f9-4654-914b-6ff69da121f2', None, None, None, None, None)] {{(pid=116368) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 18 16:37:32.141112 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-15c9bdf9-610e-4048-8641-5de0cf4ab722 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Flavor limits 0:0:0 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 18 16:37:32.141799 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-15c9bdf9-610e-4048-8641-5de0cf4ab722 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Image limits 0:0:0 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 18 16:37:32.142556 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-15c9bdf9-610e-4048-8641-5de0cf4ab722 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Flavor pref 0:0:0 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 18 16:37:32.143081 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-15c9bdf9-610e-4048-8641-5de0cf4ab722 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Image pref 0:0:0 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 18 16:37:32.143547 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-15c9bdf9-610e-4048-8641-5de0cf4ab722 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 18 16:37:32.153360 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-15c9bdf9-610e-4048-8641-5de0cf4ab722 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:32.154500 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-15c9bdf9-610e-4048-8641-5de0cf4ab722 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:32.155522 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-15c9bdf9-610e-4048-8641-5de0cf4ab722 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:32.156294 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-15c9bdf9-610e-4048-8641-5de0cf4ab722 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:32.181424 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.quota [None req-15c9bdf9-610e-4048-8641-5de0cf4ab722 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Getting quotas for project 7b7c9d7399db4865a899d61aa89b988d. Resources: {'ram', 'instances', 'cores'} {{(pid=116368) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 16:37:32.187780 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.quota [None req-15c9bdf9-610e-4048-8641-5de0cf4ab722 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Getting quotas for user 08aeeb75184240ce9c0c17fc54e6eb18 and project 7b7c9d7399db4865a899d61aa89b988d. Resources: {'ram', 'instances', 'cores'} {{(pid=116368) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 16:37:32.205717 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-15c9bdf9-610e-4048-8641-5de0cf4ab722 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Going to run 1 instances... {{(pid=116368) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 18 16:37:32.209597 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-15c9bdf9-610e-4048-8641-5de0cf4ab722 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='900c4a9d-b6c6-451f-a509-eb4f4b49f459',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116368) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 18 16:37:32.268607 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-15c9bdf9-610e-4048-8641-5de0cf4ab722 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.676058 Jan 18 16:37:32.268607 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 434/878] 10.222.0.82 () {60 vars in 1146 bytes} [Tue Jan 18 16:37:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 18 16:37:32.281083 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-314cb200-1691-4b42-8d43-21c6126953ed tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:37:32.281851 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-314cb200-1691-4b42-8d43-21c6126953ed tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:37:32.357463 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-314cb200-1691-4b42-8d43-21c6126953ed tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:37:32.369424 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-314cb200-1691-4b42-8d43-21c6126953ed tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515" status: 200 len: 1238 microversion: 2.1 time: 0.092025 Jan 18 16:37:32.369798 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 445/879] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:37:32 2022] GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515 => generated 1238 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:37:33.387198 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-82c0a7b3-853e-4e45-aef3-cf9e36a7bbba tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:37:33.387965 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-82c0a7b3-853e-4e45-aef3-cf9e36a7bbba tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:37:33.394207 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-82c0a7b3-853e-4e45-aef3-cf9e36a7bbba tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:33.394796 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-82c0a7b3-853e-4e45-aef3-cf9e36a7bbba tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:33.395671 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-82c0a7b3-853e-4e45-aef3-cf9e36a7bbba tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:33.397064 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-82c0a7b3-853e-4e45-aef3-cf9e36a7bbba tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:33.474230 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-82c0a7b3-853e-4e45-aef3-cf9e36a7bbba tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:37:33.482002 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-82c0a7b3-853e-4e45-aef3-cf9e36a7bbba tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515" status: 200 len: 1308 microversion: 2.1 time: 0.098879 Jan 18 16:37:33.482585 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 435/880] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:37:33 2022] GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515 => generated 1308 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:37:34.499749 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-bd940601-5735-436a-b3c4-bf12be08e242 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:37:34.500382 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-bd940601-5735-436a-b3c4-bf12be08e242 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:37:34.507964 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-bd940601-5735-436a-b3c4-bf12be08e242 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:34.508654 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-bd940601-5735-436a-b3c4-bf12be08e242 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:34.509527 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-bd940601-5735-436a-b3c4-bf12be08e242 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:34.509965 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-bd940601-5735-436a-b3c4-bf12be08e242 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:34.745748 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-bd940601-5735-436a-b3c4-bf12be08e242 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:37:34.753640 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-bd940601-5735-436a-b3c4-bf12be08e242 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515" status: 200 len: 1363 microversion: 2.1 time: 0.257849 Jan 18 16:37:34.754714 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 446/881] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:37:34 2022] GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515 => generated 1363 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:37:34.844669 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [req-80130d12-f118-43c1-8077-6a509b9ae580 req-12655499-27d1-4e7e-b4a8-f453b24391d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c365b3e-1a90-40d6-8269-84bbf61e7515", "tag": "7a80e69a-7561-4746-bbc6-6bf9690c4752"}]} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:37:34.846433 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:37:34.846433 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: warnings.warn(msg) Jan 18 16:37:34.870101 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-80130d12-f118-43c1-8077-6a509b9ae580 req-12655499-27d1-4e7e-b4a8-f453b24391d8 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:34.870684 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-80130d12-f118-43c1-8077-6a509b9ae580 req-12655499-27d1-4e7e-b4a8-f453b24391d8 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:34.883481 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.compute.server_external_events [req-80130d12-f118-43c1-8077-6a509b9ae580 req-12655499-27d1-4e7e-b4a8-f453b24391d8 service nova] Creating event network-changed:7a80e69a-7561-4746-bbc6-6bf9690c4752 for instance 7c365b3e-1a90-40d6-8269-84bbf61e7515 on hv-cinder-78836 Jan 18 16:37:34.889146 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [req-80130d12-f118-43c1-8077-6a509b9ae580 req-12655499-27d1-4e7e-b4a8-f453b24391d8 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049638 Jan 18 16:37:34.890085 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 436/882] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:37:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:37:35.771911 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-482ed4e6-04da-457e-a429-391cd534ab4d tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:37:35.773325 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-482ed4e6-04da-457e-a429-391cd534ab4d tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:37:35.779814 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-482ed4e6-04da-457e-a429-391cd534ab4d tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:35.780354 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-482ed4e6-04da-457e-a429-391cd534ab4d tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:35.781110 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-482ed4e6-04da-457e-a429-391cd534ab4d tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:35.781584 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-482ed4e6-04da-457e-a429-391cd534ab4d tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:35.921345 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-482ed4e6-04da-457e-a429-391cd534ab4d tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:37:35.928626 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-482ed4e6-04da-457e-a429-391cd534ab4d tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515" status: 200 len: 1363 microversion: 2.1 time: 0.160918 Jan 18 16:37:35.929207 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 447/883] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:37:35 2022] GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:37:36.948320 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-93fe762e-bf90-4237-af6b-5ff1b06b0be4 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:37:36.949340 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-93fe762e-bf90-4237-af6b-5ff1b06b0be4 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:37:36.955574 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-93fe762e-bf90-4237-af6b-5ff1b06b0be4 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:36.956097 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-93fe762e-bf90-4237-af6b-5ff1b06b0be4 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:36.956966 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-93fe762e-bf90-4237-af6b-5ff1b06b0be4 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:36.957607 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-93fe762e-bf90-4237-af6b-5ff1b06b0be4 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:37.113293 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-93fe762e-bf90-4237-af6b-5ff1b06b0be4 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:37:37.121760 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-93fe762e-bf90-4237-af6b-5ff1b06b0be4 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515" status: 200 len: 1363 microversion: 2.1 time: 0.179907 Jan 18 16:37:37.122344 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 437/884] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:37:36 2022] GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:37:38.138278 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-0f0c8d89-2fee-4103-aaf1-aa1085fbd17f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:37:38.138887 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-0f0c8d89-2fee-4103-aaf1-aa1085fbd17f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:37:38.145194 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0f0c8d89-2fee-4103-aaf1-aa1085fbd17f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:38.145752 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0f0c8d89-2fee-4103-aaf1-aa1085fbd17f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:38.146773 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0f0c8d89-2fee-4103-aaf1-aa1085fbd17f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:38.146916 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0f0c8d89-2fee-4103-aaf1-aa1085fbd17f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:38.282752 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-0f0c8d89-2fee-4103-aaf1-aa1085fbd17f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:37:38.290207 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-0f0c8d89-2fee-4103-aaf1-aa1085fbd17f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515" status: 200 len: 1363 microversion: 2.1 time: 0.155631 Jan 18 16:37:38.290781 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 448/885] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:37:38 2022] GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:37:39.307104 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-4de86799-30b1-4c9f-a830-a343a48cd42e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:37:39.307716 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-4de86799-30b1-4c9f-a830-a343a48cd42e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:37:39.314032 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4de86799-30b1-4c9f-a830-a343a48cd42e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:39.314472 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4de86799-30b1-4c9f-a830-a343a48cd42e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:39.315247 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4de86799-30b1-4c9f-a830-a343a48cd42e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:39.315676 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4de86799-30b1-4c9f-a830-a343a48cd42e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:39.453006 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-4de86799-30b1-4c9f-a830-a343a48cd42e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:37:39.461367 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-4de86799-30b1-4c9f-a830-a343a48cd42e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515" status: 200 len: 1363 microversion: 2.1 time: 0.157953 Jan 18 16:37:39.461953 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 438/886] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:37:39 2022] GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:37:40.478549 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-8a58b030-6ce5-4710-bea2-87e9041a0641 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:37:40.479113 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-8a58b030-6ce5-4710-bea2-87e9041a0641 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:37:40.497096 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-8a58b030-6ce5-4710-bea2-87e9041a0641 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:40.497540 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-8a58b030-6ce5-4710-bea2-87e9041a0641 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:40.498320 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-8a58b030-6ce5-4710-bea2-87e9041a0641 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:40.498767 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-8a58b030-6ce5-4710-bea2-87e9041a0641 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:40.632572 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-8a58b030-6ce5-4710-bea2-87e9041a0641 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:37:40.640143 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-8a58b030-6ce5-4710-bea2-87e9041a0641 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515" status: 200 len: 1363 microversion: 2.1 time: 0.165876 Jan 18 16:37:40.640704 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 449/887] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:37:40 2022] GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:37:41.658280 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-536daf90-d698-4a0f-b190-e5170304d197 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:37:41.658862 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-536daf90-d698-4a0f-b190-e5170304d197 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:37:41.665733 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-536daf90-d698-4a0f-b190-e5170304d197 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:41.666170 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-536daf90-d698-4a0f-b190-e5170304d197 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:41.666944 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-536daf90-d698-4a0f-b190-e5170304d197 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:41.667378 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-536daf90-d698-4a0f-b190-e5170304d197 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:41.800013 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-536daf90-d698-4a0f-b190-e5170304d197 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:37:41.808466 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-536daf90-d698-4a0f-b190-e5170304d197 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515" status: 200 len: 1363 microversion: 2.1 time: 0.153786 Jan 18 16:37:41.809059 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 439/888] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:37:41 2022] GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:37:42.029064 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [req-e7ef3eac-31cc-48fa-8045-228010c14bff req-e5654845-75b9-4990-80ab-745df98af0a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c365b3e-1a90-40d6-8269-84bbf61e7515", "name": "network-vif-plugged", "status": "completed", "tag": "7a80e69a-7561-4746-bbc6-6bf9690c4752"}]} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:37:42.030609 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:37:42.030609 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: warnings.warn(msg) Jan 18 16:37:42.040339 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-e7ef3eac-31cc-48fa-8045-228010c14bff req-e5654845-75b9-4990-80ab-745df98af0a6 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:42.040806 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-e7ef3eac-31cc-48fa-8045-228010c14bff req-e5654845-75b9-4990-80ab-745df98af0a6 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:42.054452 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.compute.server_external_events [req-e7ef3eac-31cc-48fa-8045-228010c14bff req-e5654845-75b9-4990-80ab-745df98af0a6 service nova] Creating event network-vif-plugged:7a80e69a-7561-4746-bbc6-6bf9690c4752 for instance 7c365b3e-1a90-40d6-8269-84bbf61e7515 on hv-cinder-78836 Jan 18 16:37:42.059590 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [req-e7ef3eac-31cc-48fa-8045-228010c14bff req-e5654845-75b9-4990-80ab-745df98af0a6 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034232 Jan 18 16:37:42.060269 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 450/889] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:37:42.825310 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-dc7d8002-86a2-4066-8b24-ec41798d76c7 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:37:42.825938 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-dc7d8002-86a2-4066-8b24-ec41798d76c7 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:37:42.832770 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-dc7d8002-86a2-4066-8b24-ec41798d76c7 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:42.833255 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-dc7d8002-86a2-4066-8b24-ec41798d76c7 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:42.834151 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-dc7d8002-86a2-4066-8b24-ec41798d76c7 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:42.835136 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-dc7d8002-86a2-4066-8b24-ec41798d76c7 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:42.970061 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-dc7d8002-86a2-4066-8b24-ec41798d76c7 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:37:42.978136 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-dc7d8002-86a2-4066-8b24-ec41798d76c7 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515" status: 200 len: 1363 microversion: 2.1 time: 0.156401 Jan 18 16:37:42.978710 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 440/890] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:37:42 2022] GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:37:43.776023 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-2b9817f4-5316-4d22-b94e-61f0c154714e tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1722918866", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-528604224", "security_groups": [{"name": "tempest-secgroup-smoke-2112687843"}], "block_device_mapping_v2": [{"uuid": "d84b498b-ab08-4893-9f6b-25917a952a61", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1553074d-8be9-4ad2-b3ce-7b8026c06eda"}]}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:37:43.888998 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.network.neutron [None req-2b9817f4-5316-4d22-b94e-61f0c154714e tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] validate_networks() for [('1553074d-8be9-4ad2-b3ce-7b8026c06eda', None, None, None, None, None)] {{(pid=116367) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 18 16:37:43.998582 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-feebfd0a-fa9e-4712-abeb-ec3fa80d88ad tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:37:43.999723 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-feebfd0a-fa9e-4712-abeb-ec3fa80d88ad tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:37:44.011238 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-feebfd0a-fa9e-4712-abeb-ec3fa80d88ad tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:44.011983 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-feebfd0a-fa9e-4712-abeb-ec3fa80d88ad tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:44.013396 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-feebfd0a-fa9e-4712-abeb-ec3fa80d88ad tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:44.014255 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-feebfd0a-fa9e-4712-abeb-ec3fa80d88ad tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:44.208627 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-feebfd0a-fa9e-4712-abeb-ec3fa80d88ad tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:37:44.217120 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-feebfd0a-fa9e-4712-abeb-ec3fa80d88ad tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515" status: 200 len: 1549 microversion: 2.1 time: 0.225668 Jan 18 16:37:44.217709 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 441/891] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:37:43 2022] GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515 => generated 1549 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:37:44.233960 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-ebaf1e3a-6bdf-4cdc-b176-a0e00ddbddf8 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:37:44.234560 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-ebaf1e3a-6bdf-4cdc-b176-a0e00ddbddf8 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:37:44.241113 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ebaf1e3a-6bdf-4cdc-b176-a0e00ddbddf8 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:44.241627 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ebaf1e3a-6bdf-4cdc-b176-a0e00ddbddf8 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:44.242604 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ebaf1e3a-6bdf-4cdc-b176-a0e00ddbddf8 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:44.243077 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ebaf1e3a-6bdf-4cdc-b176-a0e00ddbddf8 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:44.389387 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-ebaf1e3a-6bdf-4cdc-b176-a0e00ddbddf8 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.158974 Jan 18 16:37:44.389996 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 442/892] 10.222.0.82 () {58 vars in 1274 bytes} [Tue Jan 18 16:37:44 2022] GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/os-interface => generated 285 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 16:37:44.416531 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.virt.hardware [None req-2b9817f4-5316-4d22-b94e-61f0c154714e tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Flavor limits 0:0:0 {{(pid=116367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 18 16:37:44.416992 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.virt.hardware [None req-2b9817f4-5316-4d22-b94e-61f0c154714e tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Image limits 0:0:0 {{(pid=116367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 18 16:37:44.417471 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.virt.hardware [None req-2b9817f4-5316-4d22-b94e-61f0c154714e tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Flavor pref 0:0:0 {{(pid=116367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 18 16:37:44.417880 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.virt.hardware [None req-2b9817f4-5316-4d22-b94e-61f0c154714e tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Image pref 0:0:0 {{(pid=116367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 18 16:37:44.418298 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.virt.hardware [None req-2b9817f4-5316-4d22-b94e-61f0c154714e tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 18 16:37:44.427129 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2b9817f4-5316-4d22-b94e-61f0c154714e tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:44.427578 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2b9817f4-5316-4d22-b94e-61f0c154714e tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:44.428423 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2b9817f4-5316-4d22-b94e-61f0c154714e tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:44.428853 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2b9817f4-5316-4d22-b94e-61f0c154714e tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:44.446673 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.quota [None req-2b9817f4-5316-4d22-b94e-61f0c154714e tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Getting quotas for project 89b9ac86cb4c4f109b49c6f9a66379a4. Resources: {'ram', 'instances', 'cores'} {{(pid=116367) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 16:37:44.450687 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.quota [None req-2b9817f4-5316-4d22-b94e-61f0c154714e tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Getting quotas for user 345686887fc3424fa518114e23f7fcc6 and project 89b9ac86cb4c4f109b49c6f9a66379a4. Resources: {'ram', 'instances', 'cores'} {{(pid=116367) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 16:37:44.518379 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-2b9817f4-5316-4d22-b94e-61f0c154714e tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Going to run 1 instances... {{(pid=116367) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 18 16:37:44.520640 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-2b9817f4-5316-4d22-b94e-61f0c154714e tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: ee1e9d7a-4800-4716-8b74-cc144c0722ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d84b498b-ab08-4893-9f6b-25917a952a61',volume_size=None,volume_type=None)] {{(pid=116367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 18 16:37:44.646616 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-2b9817f4-5316-4d22-b94e-61f0c154714e tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.875344 Jan 18 16:37:44.648515 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 451/893] 10.222.0.82 () {60 vars in 1146 bytes} [Tue Jan 18 16:37:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 878 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 18 16:37:44.657989 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-2160c9b0-32f0-4894-8773-3703e49b92f1 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:37:44.658609 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-2160c9b0-32f0-4894-8773-3703e49b92f1 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: ee1e9d7a-4800-4716-8b74-cc144c0722ce] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:37:44.714599 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-2160c9b0-32f0-4894-8773-3703e49b92f1 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:37:44.721552 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-2160c9b0-32f0-4894-8773-3703e49b92f1 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/ee1e9d7a-4800-4716-8b74-cc144c0722ce" status: 200 len: 1094 microversion: 2.1 time: 0.067302 Jan 18 16:37:44.722389 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 443/894] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:37:44 2022] GET /compute/v2.1/servers/ee1e9d7a-4800-4716-8b74-cc144c0722ce => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:37:45.459103 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-e6a59329-d200-435f-99f9-51ab479d4442 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:37:45.460882 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-e6a59329-d200-435f-99f9-51ab479d4442 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:37:45.466455 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [req-dc734c17-25df-497c-9764-c45ee8cfc9a5 req-eef10491-25bc-4923-9c76-1099dfe6dc87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c365b3e-1a90-40d6-8269-84bbf61e7515", "tag": "7a80e69a-7561-4746-bbc6-6bf9690c4752"}]} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:37:45.467949 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e6a59329-d200-435f-99f9-51ab479d4442 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:45.468408 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e6a59329-d200-435f-99f9-51ab479d4442 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:45.469217 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e6a59329-d200-435f-99f9-51ab479d4442 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:45.469824 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e6a59329-d200-435f-99f9-51ab479d4442 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:45.469946 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:37:45.469946 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: warnings.warn(msg) Jan 18 16:37:45.483911 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-dc734c17-25df-497c-9764-c45ee8cfc9a5 req-eef10491-25bc-4923-9c76-1099dfe6dc87 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:45.484994 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-dc734c17-25df-497c-9764-c45ee8cfc9a5 req-eef10491-25bc-4923-9c76-1099dfe6dc87 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:45.497636 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.compute.server_external_events [req-dc734c17-25df-497c-9764-c45ee8cfc9a5 req-eef10491-25bc-4923-9c76-1099dfe6dc87 service nova] Creating event network-changed:7a80e69a-7561-4746-bbc6-6bf9690c4752 for instance 7c365b3e-1a90-40d6-8269-84bbf61e7515 on hv-cinder-78836 Jan 18 16:37:45.503304 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [req-dc734c17-25df-497c-9764-c45ee8cfc9a5 req-eef10491-25bc-4923-9c76-1099dfe6dc87 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044209 Jan 18 16:37:45.503901 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 444/895] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:37:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 16:37:45.533159 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-e6a59329-d200-435f-99f9-51ab479d4442 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action" status: 200 len: 14 microversion: 2.1 time: 0.078374 Jan 18 16:37:45.533803 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 452/896] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:37:45 2022] POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 18 16:37:45.739796 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-1262678e-bfa1-45fd-9127-0d7eacb70068 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:37:45.741886 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-1262678e-bfa1-45fd-9127-0d7eacb70068 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: ee1e9d7a-4800-4716-8b74-cc144c0722ce] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:37:45.748751 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1262678e-bfa1-45fd-9127-0d7eacb70068 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:45.749459 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1262678e-bfa1-45fd-9127-0d7eacb70068 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:45.750452 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1262678e-bfa1-45fd-9127-0d7eacb70068 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:45.751054 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1262678e-bfa1-45fd-9127-0d7eacb70068 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:45.871713 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-1262678e-bfa1-45fd-9127-0d7eacb70068 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:37:45.884835 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-1262678e-bfa1-45fd-9127-0d7eacb70068 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/ee1e9d7a-4800-4716-8b74-cc144c0722ce" status: 200 len: 1210 microversion: 2.1 time: 0.149720 Jan 18 16:37:45.895321 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 445/897] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:37:45 2022] GET /compute/v2.1/servers/ee1e9d7a-4800-4716-8b74-cc144c0722ce => generated 1210 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:37:46.547406 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-bd69f44e-d99c-4dbc-b652-802991537268 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:37:46.547406 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-bd69f44e-d99c-4dbc-b652-802991537268 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:37:46.556254 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-bd69f44e-d99c-4dbc-b652-802991537268 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:46.557276 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-bd69f44e-d99c-4dbc-b652-802991537268 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:46.559678 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-bd69f44e-d99c-4dbc-b652-802991537268 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:46.560763 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-bd69f44e-d99c-4dbc-b652-802991537268 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:46.650719 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-bd69f44e-d99c-4dbc-b652-802991537268 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action" status: 200 len: 14 microversion: 2.1 time: 0.109391 Jan 18 16:37:46.653314 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 453/898] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:37:46 2022] POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 18 16:37:46.902660 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-c9e5098c-1888-4643-b552-4134f28d3955 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:37:46.903255 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-c9e5098c-1888-4643-b552-4134f28d3955 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: ee1e9d7a-4800-4716-8b74-cc144c0722ce] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:37:46.909206 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c9e5098c-1888-4643-b552-4134f28d3955 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:46.909656 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c9e5098c-1888-4643-b552-4134f28d3955 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:46.910445 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c9e5098c-1888-4643-b552-4134f28d3955 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:46.910881 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c9e5098c-1888-4643-b552-4134f28d3955 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:47.060336 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-c9e5098c-1888-4643-b552-4134f28d3955 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:37:47.069058 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-c9e5098c-1888-4643-b552-4134f28d3955 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/ee1e9d7a-4800-4716-8b74-cc144c0722ce" status: 200 len: 1266 microversion: 2.1 time: 0.170502 Jan 18 16:37:47.070354 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 446/899] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:37:46 2022] GET /compute/v2.1/servers/ee1e9d7a-4800-4716-8b74-cc144c0722ce => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:37:47.524503 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [req-e55c5336-0e57-40bf-a566-25c457c64aeb req-e42e3ca8-822d-49fd-94c8-d574bb3b754a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee1e9d7a-4800-4716-8b74-cc144c0722ce", "tag": "b307d78d-8690-4dee-b716-4f18e6567bfe"}]} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:37:47.526118 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:37:47.526118 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: warnings.warn(msg) Jan 18 16:37:47.534974 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-e55c5336-0e57-40bf-a566-25c457c64aeb req-e42e3ca8-822d-49fd-94c8-d574bb3b754a service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:47.535666 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-e55c5336-0e57-40bf-a566-25c457c64aeb req-e42e3ca8-822d-49fd-94c8-d574bb3b754a service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:47.551899 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.compute.server_external_events [req-e55c5336-0e57-40bf-a566-25c457c64aeb req-e42e3ca8-822d-49fd-94c8-d574bb3b754a service nova] Creating event network-changed:b307d78d-8690-4dee-b716-4f18e6567bfe for instance ee1e9d7a-4800-4716-8b74-cc144c0722ce on hv-cinder-78836 Jan 18 16:37:47.557677 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [req-e55c5336-0e57-40bf-a566-25c457c64aeb req-e42e3ca8-822d-49fd-94c8-d574bb3b754a service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041059 Jan 18 16:37:47.558621 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 454/900] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:37:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:37:47.663540 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-e9def364-eeb5-4016-b5a3-9ec036c87fcd tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:37:47.664454 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-e9def364-eeb5-4016-b5a3-9ec036c87fcd tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:37:47.671589 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e9def364-eeb5-4016-b5a3-9ec036c87fcd tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:47.671589 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e9def364-eeb5-4016-b5a3-9ec036c87fcd tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:47.671862 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e9def364-eeb5-4016-b5a3-9ec036c87fcd tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:47.672161 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e9def364-eeb5-4016-b5a3-9ec036c87fcd tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:47.732206 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-e9def364-eeb5-4016-b5a3-9ec036c87fcd tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action" status: 200 len: 14 microversion: 2.1 time: 0.072084 Jan 18 16:37:47.732880 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 447/901] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:37:47 2022] POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 18 16:37:48.088395 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-896d327d-0997-448f-b0de-eb2983cd0215 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:37:48.089241 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-896d327d-0997-448f-b0de-eb2983cd0215 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: ee1e9d7a-4800-4716-8b74-cc144c0722ce] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:37:48.096083 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-896d327d-0997-448f-b0de-eb2983cd0215 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:48.096527 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-896d327d-0997-448f-b0de-eb2983cd0215 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:48.097366 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-896d327d-0997-448f-b0de-eb2983cd0215 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:48.097800 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-896d327d-0997-448f-b0de-eb2983cd0215 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:48.243184 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-896d327d-0997-448f-b0de-eb2983cd0215 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:37:48.252238 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-896d327d-0997-448f-b0de-eb2983cd0215 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/ee1e9d7a-4800-4716-8b74-cc144c0722ce" status: 200 len: 1266 microversion: 2.1 time: 0.168829 Jan 18 16:37:48.252819 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 455/902] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:37:48 2022] GET /compute/v2.1/servers/ee1e9d7a-4800-4716-8b74-cc144c0722ce => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:37:48.743962 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-c55e6e6e-ff1e-49f6-be46-6914adc70dea tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:37:48.744984 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-c55e6e6e-ff1e-49f6-be46-6914adc70dea tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:37:48.751997 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c55e6e6e-ff1e-49f6-be46-6914adc70dea tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:48.752447 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c55e6e6e-ff1e-49f6-be46-6914adc70dea tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:48.753268 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c55e6e6e-ff1e-49f6-be46-6914adc70dea tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:48.753711 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c55e6e6e-ff1e-49f6-be46-6914adc70dea tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:48.813065 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-c55e6e6e-ff1e-49f6-be46-6914adc70dea tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action" status: 200 len: 14 microversion: 2.1 time: 0.073172 Jan 18 16:37:48.813740 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 448/903] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:37:48 2022] POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 18 16:37:49.269368 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-891344eb-1b81-4516-a44d-2af5bec41a9b tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:37:49.269994 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-891344eb-1b81-4516-a44d-2af5bec41a9b tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: ee1e9d7a-4800-4716-8b74-cc144c0722ce] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:37:49.277168 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-891344eb-1b81-4516-a44d-2af5bec41a9b tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:49.277619 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-891344eb-1b81-4516-a44d-2af5bec41a9b tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:49.278432 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-891344eb-1b81-4516-a44d-2af5bec41a9b tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:49.278868 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-891344eb-1b81-4516-a44d-2af5bec41a9b tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:49.415642 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-891344eb-1b81-4516-a44d-2af5bec41a9b tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:37:49.422872 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-891344eb-1b81-4516-a44d-2af5bec41a9b tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/ee1e9d7a-4800-4716-8b74-cc144c0722ce" status: 200 len: 1266 microversion: 2.1 time: 0.157230 Jan 18 16:37:49.423430 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 456/904] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:37:49 2022] GET /compute/v2.1/servers/ee1e9d7a-4800-4716-8b74-cc144c0722ce => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:37:49.829452 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-f96a6322-ea85-4124-abec-eca998f2b1f4 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:37:49.830351 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-f96a6322-ea85-4124-abec-eca998f2b1f4 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:37:49.837408 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f96a6322-ea85-4124-abec-eca998f2b1f4 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:49.837860 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f96a6322-ea85-4124-abec-eca998f2b1f4 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:49.838673 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f96a6322-ea85-4124-abec-eca998f2b1f4 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:49.839111 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f96a6322-ea85-4124-abec-eca998f2b1f4 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:49.902561 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-f96a6322-ea85-4124-abec-eca998f2b1f4 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action" status: 200 len: 14 microversion: 2.1 time: 0.077195 Jan 18 16:37:49.903231 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 449/905] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:37:49 2022] POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 18 16:37:50.439488 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-cb73d444-161b-420d-ba73-4a5e14b2a1f8 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:37:50.440142 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-cb73d444-161b-420d-ba73-4a5e14b2a1f8 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: ee1e9d7a-4800-4716-8b74-cc144c0722ce] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:37:50.447670 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-cb73d444-161b-420d-ba73-4a5e14b2a1f8 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:50.448125 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-cb73d444-161b-420d-ba73-4a5e14b2a1f8 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:50.448973 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-cb73d444-161b-420d-ba73-4a5e14b2a1f8 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:50.449412 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-cb73d444-161b-420d-ba73-4a5e14b2a1f8 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:50.581635 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-cb73d444-161b-420d-ba73-4a5e14b2a1f8 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:37:50.588999 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-cb73d444-161b-420d-ba73-4a5e14b2a1f8 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/ee1e9d7a-4800-4716-8b74-cc144c0722ce" status: 200 len: 1266 microversion: 2.1 time: 0.153134 Jan 18 16:37:50.589584 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 457/906] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:37:50 2022] GET /compute/v2.1/servers/ee1e9d7a-4800-4716-8b74-cc144c0722ce => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:37:50.915750 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-54d31762-08ca-4a05-9611-a54d59c08e4b tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:37:50.916665 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-54d31762-08ca-4a05-9611-a54d59c08e4b tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:37:50.923793 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-54d31762-08ca-4a05-9611-a54d59c08e4b tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:50.924247 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-54d31762-08ca-4a05-9611-a54d59c08e4b tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:50.925067 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-54d31762-08ca-4a05-9611-a54d59c08e4b tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:50.925507 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-54d31762-08ca-4a05-9611-a54d59c08e4b tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:50.987337 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-54d31762-08ca-4a05-9611-a54d59c08e4b tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action" status: 200 len: 14 microversion: 2.1 time: 0.076163 Jan 18 16:37:50.987973 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 450/907] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:37:50 2022] POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 18 16:37:51.605638 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-ea004931-5d9e-4830-a913-5e9da5ba34ad tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:37:51.606165 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-ea004931-5d9e-4830-a913-5e9da5ba34ad tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: ee1e9d7a-4800-4716-8b74-cc144c0722ce] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:37:51.612367 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-ea004931-5d9e-4830-a913-5e9da5ba34ad tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:51.612817 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-ea004931-5d9e-4830-a913-5e9da5ba34ad tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:51.613830 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-ea004931-5d9e-4830-a913-5e9da5ba34ad tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:51.614262 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-ea004931-5d9e-4830-a913-5e9da5ba34ad tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:51.758012 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-ea004931-5d9e-4830-a913-5e9da5ba34ad tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:37:51.765363 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-ea004931-5d9e-4830-a913-5e9da5ba34ad tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/ee1e9d7a-4800-4716-8b74-cc144c0722ce" status: 200 len: 1266 microversion: 2.1 time: 0.163410 Jan 18 16:37:51.765944 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 458/908] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:37:51 2022] GET /compute/v2.1/servers/ee1e9d7a-4800-4716-8b74-cc144c0722ce => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:37:52.004796 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-234ed41d-ac99-4828-b52f-fd76d4b50f3a tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:37:52.005803 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-234ed41d-ac99-4828-b52f-fd76d4b50f3a tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:37:52.013525 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-234ed41d-ac99-4828-b52f-fd76d4b50f3a tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:52.013968 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-234ed41d-ac99-4828-b52f-fd76d4b50f3a tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:52.014749 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-234ed41d-ac99-4828-b52f-fd76d4b50f3a tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:52.015174 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-234ed41d-ac99-4828-b52f-fd76d4b50f3a tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:52.075941 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-234ed41d-ac99-4828-b52f-fd76d4b50f3a tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action" status: 200 len: 14 microversion: 2.1 time: 0.075495 Jan 18 16:37:52.076595 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 451/909] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:37:51 2022] POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 18 16:37:52.782411 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-41629ea8-7a56-46b0-8c7b-da2d0ee5c7cc tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:37:52.783050 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-41629ea8-7a56-46b0-8c7b-da2d0ee5c7cc tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: ee1e9d7a-4800-4716-8b74-cc144c0722ce] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:37:52.789697 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-41629ea8-7a56-46b0-8c7b-da2d0ee5c7cc tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:52.790147 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-41629ea8-7a56-46b0-8c7b-da2d0ee5c7cc tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:52.790942 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-41629ea8-7a56-46b0-8c7b-da2d0ee5c7cc tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:52.791381 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-41629ea8-7a56-46b0-8c7b-da2d0ee5c7cc tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:52.926983 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-41629ea8-7a56-46b0-8c7b-da2d0ee5c7cc tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:37:52.934758 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-41629ea8-7a56-46b0-8c7b-da2d0ee5c7cc tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/ee1e9d7a-4800-4716-8b74-cc144c0722ce" status: 200 len: 1266 microversion: 2.1 time: 0.155769 Jan 18 16:37:52.935266 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 459/910] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:37:52 2022] GET /compute/v2.1/servers/ee1e9d7a-4800-4716-8b74-cc144c0722ce => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:37:53.087975 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-dc337c81-0212-456c-a572-2e2a5837eb8f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:37:53.088978 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-dc337c81-0212-456c-a572-2e2a5837eb8f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:37:53.095918 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-dc337c81-0212-456c-a572-2e2a5837eb8f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:53.096387 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-dc337c81-0212-456c-a572-2e2a5837eb8f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:53.097161 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-dc337c81-0212-456c-a572-2e2a5837eb8f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:53.097591 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-dc337c81-0212-456c-a572-2e2a5837eb8f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:53.157290 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-dc337c81-0212-456c-a572-2e2a5837eb8f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action" status: 200 len: 14 microversion: 2.1 time: 0.073788 Jan 18 16:37:53.157932 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 452/911] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:37:53 2022] POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 18 16:37:53.952412 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-7d07838d-26a5-4ab1-b8bd-91e87c980011 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:37:53.953095 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-7d07838d-26a5-4ab1-b8bd-91e87c980011 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: ee1e9d7a-4800-4716-8b74-cc144c0722ce] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:37:53.959360 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7d07838d-26a5-4ab1-b8bd-91e87c980011 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:53.959815 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7d07838d-26a5-4ab1-b8bd-91e87c980011 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:53.960603 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7d07838d-26a5-4ab1-b8bd-91e87c980011 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:53.961072 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7d07838d-26a5-4ab1-b8bd-91e87c980011 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:54.094698 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-7d07838d-26a5-4ab1-b8bd-91e87c980011 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:37:54.102781 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-7d07838d-26a5-4ab1-b8bd-91e87c980011 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/ee1e9d7a-4800-4716-8b74-cc144c0722ce" status: 200 len: 1266 microversion: 2.1 time: 0.154257 Jan 18 16:37:54.103344 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 460/912] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:37:53 2022] GET /compute/v2.1/servers/ee1e9d7a-4800-4716-8b74-cc144c0722ce => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:37:54.169169 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-b6f879b5-0a2a-4f75-8b11-3e589c4e7e32 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:37:54.170167 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-b6f879b5-0a2a-4f75-8b11-3e589c4e7e32 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:37:54.177125 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-b6f879b5-0a2a-4f75-8b11-3e589c4e7e32 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:54.177541 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-b6f879b5-0a2a-4f75-8b11-3e589c4e7e32 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:54.178897 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-b6f879b5-0a2a-4f75-8b11-3e589c4e7e32 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:54.179329 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-b6f879b5-0a2a-4f75-8b11-3e589c4e7e32 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:54.243578 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-b6f879b5-0a2a-4f75-8b11-3e589c4e7e32 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action" status: 200 len: 14 microversion: 2.1 time: 0.078335 Jan 18 16:37:54.244429 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 453/913] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:37:54 2022] POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 18 16:37:55.119118 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-e965f3b4-afd0-44ad-8008-efd0f4541a73 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:37:55.119701 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-e965f3b4-afd0-44ad-8008-efd0f4541a73 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: ee1e9d7a-4800-4716-8b74-cc144c0722ce] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:37:55.126004 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e965f3b4-afd0-44ad-8008-efd0f4541a73 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:55.126451 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e965f3b4-afd0-44ad-8008-efd0f4541a73 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:55.127225 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e965f3b4-afd0-44ad-8008-efd0f4541a73 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:55.127682 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e965f3b4-afd0-44ad-8008-efd0f4541a73 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:55.254941 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-a499273d-0fc6-4cf6-9692-a114e2cca34b tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:37:55.255918 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-a499273d-0fc6-4cf6-9692-a114e2cca34b tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:37:55.263152 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a499273d-0fc6-4cf6-9692-a114e2cca34b tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:55.263466 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a499273d-0fc6-4cf6-9692-a114e2cca34b tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:55.264254 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a499273d-0fc6-4cf6-9692-a114e2cca34b tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:55.264690 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a499273d-0fc6-4cf6-9692-a114e2cca34b tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:55.265518 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-e965f3b4-afd0-44ad-8008-efd0f4541a73 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:37:55.272802 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-e965f3b4-afd0-44ad-8008-efd0f4541a73 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/ee1e9d7a-4800-4716-8b74-cc144c0722ce" status: 200 len: 1266 microversion: 2.1 time: 0.157873 Jan 18 16:37:55.273410 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 461/914] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:37:55 2022] GET /compute/v2.1/servers/ee1e9d7a-4800-4716-8b74-cc144c0722ce => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:37:55.325315 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-a499273d-0fc6-4cf6-9692-a114e2cca34b tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action" status: 200 len: 14 microversion: 2.1 time: 0.074253 Jan 18 16:37:55.326070 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 454/915] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:37:55 2022] POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 18 16:37:56.289771 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-38df9170-a588-4abc-a9c6-3710df12694f tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:37:56.290372 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-38df9170-a588-4abc-a9c6-3710df12694f tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: ee1e9d7a-4800-4716-8b74-cc144c0722ce] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:37:56.296835 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-38df9170-a588-4abc-a9c6-3710df12694f tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:56.297400 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-38df9170-a588-4abc-a9c6-3710df12694f tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:56.298251 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-38df9170-a588-4abc-a9c6-3710df12694f tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:56.298687 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-38df9170-a588-4abc-a9c6-3710df12694f tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:56.336653 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-884c0b7a-8abd-40a6-8250-5d0b097c57fd tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:37:56.337666 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-884c0b7a-8abd-40a6-8250-5d0b097c57fd tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:37:56.344757 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-884c0b7a-8abd-40a6-8250-5d0b097c57fd tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:56.345285 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-884c0b7a-8abd-40a6-8250-5d0b097c57fd tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:56.346133 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-884c0b7a-8abd-40a6-8250-5d0b097c57fd tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:56.346567 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-884c0b7a-8abd-40a6-8250-5d0b097c57fd tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:56.430953 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-38df9170-a588-4abc-a9c6-3710df12694f tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:37:56.433123 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-884c0b7a-8abd-40a6-8250-5d0b097c57fd tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action" status: 200 len: 8229 microversion: 2.1 time: 0.100323 Jan 18 16:37:56.433792 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 455/916] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:37:56 2022] POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action => generated 8229 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:37:56.440670 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-38df9170-a588-4abc-a9c6-3710df12694f tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/ee1e9d7a-4800-4716-8b74-cc144c0722ce" status: 200 len: 1266 microversion: 2.1 time: 0.154869 Jan 18 16:37:56.441526 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 462/917] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:37:56 2022] GET /compute/v2.1/servers/ee1e9d7a-4800-4716-8b74-cc144c0722ce => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:37:57.445523 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-47cb08ce-33ce-4874-96bf-6ad89df4af61 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:37:57.446513 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-47cb08ce-33ce-4874-96bf-6ad89df4af61 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:37:57.453617 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-47cb08ce-33ce-4874-96bf-6ad89df4af61 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:57.454067 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-47cb08ce-33ce-4874-96bf-6ad89df4af61 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:57.454858 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-47cb08ce-33ce-4874-96bf-6ad89df4af61 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:57.455292 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-47cb08ce-33ce-4874-96bf-6ad89df4af61 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:57.457971 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-3322ac54-5f04-4962-960c-43670efc4db4 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:37:57.458726 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-3322ac54-5f04-4962-960c-43670efc4db4 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: ee1e9d7a-4800-4716-8b74-cc144c0722ce] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:37:57.465681 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-3322ac54-5f04-4962-960c-43670efc4db4 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:57.466123 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-3322ac54-5f04-4962-960c-43670efc4db4 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:57.466902 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-3322ac54-5f04-4962-960c-43670efc4db4 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:57.467329 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-3322ac54-5f04-4962-960c-43670efc4db4 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:57.533941 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-47cb08ce-33ce-4874-96bf-6ad89df4af61 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action" status: 200 len: 15856 microversion: 2.1 time: 0.092963 Jan 18 16:37:57.537457 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 456/918] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:37:57 2022] POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action => generated 15856 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:37:57.597426 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-3322ac54-5f04-4962-960c-43670efc4db4 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:37:57.604927 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-3322ac54-5f04-4962-960c-43670efc4db4 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/ee1e9d7a-4800-4716-8b74-cc144c0722ce" status: 200 len: 1266 microversion: 2.1 time: 0.150535 Jan 18 16:37:57.605513 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 463/919] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:37:57 2022] GET /compute/v2.1/servers/ee1e9d7a-4800-4716-8b74-cc144c0722ce => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:37:58.049718 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [req-704e529e-935b-4387-8a03-ced2c5a37156 req-c0f0a20a-31ae-4463-8724-fa560f9790eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee1e9d7a-4800-4716-8b74-cc144c0722ce", "name": "network-vif-plugged", "status": "completed", "tag": "b307d78d-8690-4dee-b716-4f18e6567bfe"}]} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:37:58.051222 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:37:58.051222 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: warnings.warn(msg) Jan 18 16:37:58.060273 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-704e529e-935b-4387-8a03-ced2c5a37156 req-c0f0a20a-31ae-4463-8724-fa560f9790eb service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:58.061459 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-704e529e-935b-4387-8a03-ced2c5a37156 req-c0f0a20a-31ae-4463-8724-fa560f9790eb service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:58.075423 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.compute.server_external_events [req-704e529e-935b-4387-8a03-ced2c5a37156 req-c0f0a20a-31ae-4463-8724-fa560f9790eb service nova] Creating event network-vif-plugged:b307d78d-8690-4dee-b716-4f18e6567bfe for instance ee1e9d7a-4800-4716-8b74-cc144c0722ce on hv-cinder-78836 Jan 18 16:37:58.080148 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [req-704e529e-935b-4387-8a03-ced2c5a37156 req-c0f0a20a-31ae-4463-8724-fa560f9790eb service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034545 Jan 18 16:37:58.080970 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 457/920] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:37:58.545387 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-3668014f-25d7-4213-9957-de3bf46c4d8a tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:37:58.546211 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-3668014f-25d7-4213-9957-de3bf46c4d8a tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:37:58.552321 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-3668014f-25d7-4213-9957-de3bf46c4d8a tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:58.552764 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-3668014f-25d7-4213-9957-de3bf46c4d8a tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:58.553753 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-3668014f-25d7-4213-9957-de3bf46c4d8a tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:58.554189 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-3668014f-25d7-4213-9957-de3bf46c4d8a tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:58.622336 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-5b39c5a1-6ec6-4d39-8b29-d81bc2155795 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:37:58.623033 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-5b39c5a1-6ec6-4d39-8b29-d81bc2155795 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: ee1e9d7a-4800-4716-8b74-cc144c0722ce] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:37:58.629474 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-5b39c5a1-6ec6-4d39-8b29-d81bc2155795 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:58.629923 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-5b39c5a1-6ec6-4d39-8b29-d81bc2155795 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:58.630698 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-5b39c5a1-6ec6-4d39-8b29-d81bc2155795 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:58.631168 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-5b39c5a1-6ec6-4d39-8b29-d81bc2155795 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:58.684145 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-3668014f-25d7-4213-9957-de3bf46c4d8a tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action" status: 200 len: 18356 microversion: 2.1 time: 0.142220 Jan 18 16:37:58.688010 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 464/921] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:37:58 2022] POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action => generated 18356 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:37:58.767420 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-5b39c5a1-6ec6-4d39-8b29-d81bc2155795 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:37:58.775218 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-5b39c5a1-6ec6-4d39-8b29-d81bc2155795 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/ee1e9d7a-4800-4716-8b74-cc144c0722ce" status: 200 len: 1266 microversion: 2.1 time: 0.156894 Jan 18 16:37:58.775778 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 458/922] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:37:58 2022] GET /compute/v2.1/servers/ee1e9d7a-4800-4716-8b74-cc144c0722ce => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:37:59.696549 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-c0eb183a-54d9-463b-8916-d49253f7e7f8 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:37:59.697559 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-c0eb183a-54d9-463b-8916-d49253f7e7f8 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:37:59.704320 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c0eb183a-54d9-463b-8916-d49253f7e7f8 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:59.704770 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c0eb183a-54d9-463b-8916-d49253f7e7f8 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:59.705571 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c0eb183a-54d9-463b-8916-d49253f7e7f8 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:59.706000 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c0eb183a-54d9-463b-8916-d49253f7e7f8 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:59.781472 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-c0eb183a-54d9-463b-8916-d49253f7e7f8 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action" status: 200 len: 19893 microversion: 2.1 time: 0.088849 Jan 18 16:37:59.782117 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 465/923] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:37:59 2022] POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action => generated 19893 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:37:59.792428 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-45fbc3e2-448b-4b99-976c-6e1001a7f915 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:37:59.793068 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-45fbc3e2-448b-4b99-976c-6e1001a7f915 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: ee1e9d7a-4800-4716-8b74-cc144c0722ce] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:37:59.799293 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-45fbc3e2-448b-4b99-976c-6e1001a7f915 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:59.799734 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-45fbc3e2-448b-4b99-976c-6e1001a7f915 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:59.800505 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-45fbc3e2-448b-4b99-976c-6e1001a7f915 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:59.800940 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-45fbc3e2-448b-4b99-976c-6e1001a7f915 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:59.934366 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-45fbc3e2-448b-4b99-976c-6e1001a7f915 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:37:59.941812 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-45fbc3e2-448b-4b99-976c-6e1001a7f915 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/ee1e9d7a-4800-4716-8b74-cc144c0722ce" status: 200 len: 1454 microversion: 2.1 time: 0.153540 Jan 18 16:37:59.942373 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 459/924] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:37:59 2022] GET /compute/v2.1/servers/ee1e9d7a-4800-4716-8b74-cc144c0722ce => generated 1454 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:37:59.959012 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-1c1e2edb-93bf-45a4-a29d-6642647aea38 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:37:59.959664 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-1c1e2edb-93bf-45a4-a29d-6642647aea38 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: ee1e9d7a-4800-4716-8b74-cc144c0722ce] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:37:59.966538 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-1c1e2edb-93bf-45a4-a29d-6642647aea38 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:59.966988 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-1c1e2edb-93bf-45a4-a29d-6642647aea38 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:37:59.967768 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-1c1e2edb-93bf-45a4-a29d-6642647aea38 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:37:59.968204 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-1c1e2edb-93bf-45a4-a29d-6642647aea38 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:00.108039 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-1c1e2edb-93bf-45a4-a29d-6642647aea38 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:38:00.116103 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-1c1e2edb-93bf-45a4-a29d-6642647aea38 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/ee1e9d7a-4800-4716-8b74-cc144c0722ce" status: 200 len: 1454 microversion: 2.1 time: 0.160860 Jan 18 16:38:00.116660 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 466/925] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:37:59 2022] GET /compute/v2.1/servers/ee1e9d7a-4800-4716-8b74-cc144c0722ce => generated 1454 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:38:00.793336 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-68c80bae-252f-46d7-9f85-f29e34ac8bdd tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:38:00.794318 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-68c80bae-252f-46d7-9f85-f29e34ac8bdd tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:38:00.800665 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-68c80bae-252f-46d7-9f85-f29e34ac8bdd tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:00.801155 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-68c80bae-252f-46d7-9f85-f29e34ac8bdd tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:00.801939 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-68c80bae-252f-46d7-9f85-f29e34ac8bdd tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:00.802370 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-68c80bae-252f-46d7-9f85-f29e34ac8bdd tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:00.877149 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-68c80bae-252f-46d7-9f85-f29e34ac8bdd tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action" status: 200 len: 22540 microversion: 2.1 time: 0.087355 Jan 18 16:38:00.880820 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 460/926] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:38:00 2022] POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action => generated 22540 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:38:01.773448 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [req-00deb884-9684-48fd-9031-6f7b4fb3e485 req-44d00576-d49f-4cc5-b523-740bef2c9590 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee1e9d7a-4800-4716-8b74-cc144c0722ce", "tag": "b307d78d-8690-4dee-b716-4f18e6567bfe"}]} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:38:01.775743 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:38:01.775743 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: warnings.warn(msg) Jan 18 16:38:01.783784 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-00deb884-9684-48fd-9031-6f7b4fb3e485 req-44d00576-d49f-4cc5-b523-740bef2c9590 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:01.785627 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-00deb884-9684-48fd-9031-6f7b4fb3e485 req-44d00576-d49f-4cc5-b523-740bef2c9590 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:01.811278 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.compute.server_external_events [req-00deb884-9684-48fd-9031-6f7b4fb3e485 req-44d00576-d49f-4cc5-b523-740bef2c9590 service nova] Creating event network-changed:b307d78d-8690-4dee-b716-4f18e6567bfe for instance ee1e9d7a-4800-4716-8b74-cc144c0722ce on hv-cinder-78836 Jan 18 16:38:01.816741 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [req-00deb884-9684-48fd-9031-6f7b4fb3e485 req-44d00576-d49f-4cc5-b523-740bef2c9590 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047052 Jan 18 16:38:01.817969 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 467/927] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:38:01.890786 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-8a6a454a-d211-4145-84d0-942cbdd020a5 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:38:01.891869 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-8a6a454a-d211-4145-84d0-942cbdd020a5 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:38:01.900740 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8a6a454a-d211-4145-84d0-942cbdd020a5 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:01.901497 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8a6a454a-d211-4145-84d0-942cbdd020a5 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:01.902489 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8a6a454a-d211-4145-84d0-942cbdd020a5 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:01.903072 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8a6a454a-d211-4145-84d0-942cbdd020a5 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:01.986429 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-8a6a454a-d211-4145-84d0-942cbdd020a5 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action" status: 200 len: 23797 microversion: 2.1 time: 0.101628 Jan 18 16:38:01.988980 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 461/928] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:38:01 2022] POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action => generated 23797 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:38:02.999228 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-0168444c-e52b-48d6-9393-1c24fd585db8 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:38:03.000300 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-0168444c-e52b-48d6-9393-1c24fd585db8 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:38:03.007394 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0168444c-e52b-48d6-9393-1c24fd585db8 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:03.007832 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0168444c-e52b-48d6-9393-1c24fd585db8 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:03.008596 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0168444c-e52b-48d6-9393-1c24fd585db8 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:03.009049 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0168444c-e52b-48d6-9393-1c24fd585db8 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:03.080406 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-0168444c-e52b-48d6-9393-1c24fd585db8 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action" status: 200 len: 25571 microversion: 2.1 time: 0.085044 Jan 18 16:38:03.081081 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 468/929] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:38:02 2022] POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action => generated 25571 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 18 16:38:04.092251 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-ed12528b-4dd4-40ef-8c72-bd52f2fa6cca tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:38:04.093314 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-ed12528b-4dd4-40ef-8c72-bd52f2fa6cca tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:38:04.100320 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ed12528b-4dd4-40ef-8c72-bd52f2fa6cca tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:04.100782 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ed12528b-4dd4-40ef-8c72-bd52f2fa6cca tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:04.101617 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ed12528b-4dd4-40ef-8c72-bd52f2fa6cca tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:04.102058 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ed12528b-4dd4-40ef-8c72-bd52f2fa6cca tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:04.178436 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-ed12528b-4dd4-40ef-8c72-bd52f2fa6cca tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action" status: 200 len: 26938 microversion: 2.1 time: 0.090103 Jan 18 16:38:04.179162 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 462/930] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:38:04 2022] POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action => generated 26938 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:38:05.190006 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-861cca53-72bf-4aa8-9687-0a6c50585aeb tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:38:05.191284 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-861cca53-72bf-4aa8-9687-0a6c50585aeb tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:38:05.199232 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-861cca53-72bf-4aa8-9687-0a6c50585aeb tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:05.199681 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-861cca53-72bf-4aa8-9687-0a6c50585aeb tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:05.200458 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-861cca53-72bf-4aa8-9687-0a6c50585aeb tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:05.200894 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-861cca53-72bf-4aa8-9687-0a6c50585aeb tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:05.284063 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-861cca53-72bf-4aa8-9687-0a6c50585aeb tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action" status: 200 len: 27657 microversion: 2.1 time: 0.097906 Jan 18 16:38:05.284718 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 469/931] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:38:05 2022] POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action => generated 27657 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:38:06.296754 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-d1eaa121-a6fe-4770-9010-fdc2d92b4e4d tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:38:06.297770 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-d1eaa121-a6fe-4770-9010-fdc2d92b4e4d tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:38:06.305126 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d1eaa121-a6fe-4770-9010-fdc2d92b4e4d tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:06.305573 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d1eaa121-a6fe-4770-9010-fdc2d92b4e4d tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:06.306342 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d1eaa121-a6fe-4770-9010-fdc2d92b4e4d tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:06.306771 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d1eaa121-a6fe-4770-9010-fdc2d92b4e4d tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:06.384954 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-d1eaa121-a6fe-4770-9010-fdc2d92b4e4d tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action" status: 200 len: 28142 microversion: 2.1 time: 0.092139 Jan 18 16:38:06.385595 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 463/932] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:38:06 2022] POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action => generated 28142 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:38:07.396086 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-42d3bbf2-8558-42cc-8adc-25396dbc6a53 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:38:07.397534 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-42d3bbf2-8558-42cc-8adc-25396dbc6a53 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:38:07.404323 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-42d3bbf2-8558-42cc-8adc-25396dbc6a53 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:07.404770 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-42d3bbf2-8558-42cc-8adc-25396dbc6a53 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:07.405582 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-42d3bbf2-8558-42cc-8adc-25396dbc6a53 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:07.406015 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-42d3bbf2-8558-42cc-8adc-25396dbc6a53 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:07.481993 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-42d3bbf2-8558-42cc-8adc-25396dbc6a53 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action" status: 200 len: 28204 microversion: 2.1 time: 0.089786 Jan 18 16:38:07.482619 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 470/933] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:38:07 2022] POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action => generated 28204 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:38:08.494882 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-4432a792-8199-4388-b6d9-d02adeec3e19 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:38:08.495863 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-4432a792-8199-4388-b6d9-d02adeec3e19 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:38:08.502729 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4432a792-8199-4388-b6d9-d02adeec3e19 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:08.503171 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4432a792-8199-4388-b6d9-d02adeec3e19 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:08.503943 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4432a792-8199-4388-b6d9-d02adeec3e19 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:08.504371 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4432a792-8199-4388-b6d9-d02adeec3e19 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:08.589756 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-4432a792-8199-4388-b6d9-d02adeec3e19 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action" status: 200 len: 28495 microversion: 2.1 time: 0.099359 Jan 18 16:38:08.590538 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 464/934] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:38:08 2022] POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action => generated 28495 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:38:09.603356 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-e881ce74-ae9f-4713-a6fc-c83fdb88baed tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:38:09.604269 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-e881ce74-ae9f-4713-a6fc-c83fdb88baed tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:38:09.611074 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e881ce74-ae9f-4713-a6fc-c83fdb88baed tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:09.611529 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e881ce74-ae9f-4713-a6fc-c83fdb88baed tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:09.612310 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e881ce74-ae9f-4713-a6fc-c83fdb88baed tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:09.612746 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e881ce74-ae9f-4713-a6fc-c83fdb88baed tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:09.685031 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-e881ce74-ae9f-4713-a6fc-c83fdb88baed tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action" status: 200 len: 28663 microversion: 2.1 time: 0.087436 Jan 18 16:38:09.685930 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 471/935] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:38:09 2022] POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action => generated 28663 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 18 16:38:10.697508 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-97bcde00-8e0e-497a-9f7c-7c55d78a695a tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:38:10.698516 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-97bcde00-8e0e-497a-9f7c-7c55d78a695a tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:38:10.705262 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-97bcde00-8e0e-497a-9f7c-7c55d78a695a tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:10.705701 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-97bcde00-8e0e-497a-9f7c-7c55d78a695a tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:10.706463 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-97bcde00-8e0e-497a-9f7c-7c55d78a695a tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:10.706889 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-97bcde00-8e0e-497a-9f7c-7c55d78a695a tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:10.775644 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-97bcde00-8e0e-497a-9f7c-7c55d78a695a tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action" status: 200 len: 28663 microversion: 2.1 time: 0.083044 Jan 18 16:38:10.776277 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 465/936] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:38:10 2022] POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action => generated 28663 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:38:11.787724 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-feb0184f-6695-44f8-a335-e833feb0d8e8 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:38:11.788730 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-feb0184f-6695-44f8-a335-e833feb0d8e8 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:38:11.795630 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-feb0184f-6695-44f8-a335-e833feb0d8e8 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:11.796185 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-feb0184f-6695-44f8-a335-e833feb0d8e8 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:11.796873 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-feb0184f-6695-44f8-a335-e833feb0d8e8 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:11.797333 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-feb0184f-6695-44f8-a335-e833feb0d8e8 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:11.867290 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-feb0184f-6695-44f8-a335-e833feb0d8e8 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action" status: 200 len: 28663 microversion: 2.1 time: 0.083343 Jan 18 16:38:11.871337 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 472/937] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:38:11 2022] POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action => generated 28663 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:38:12.435950 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-37b9b8d8-fd6e-47e5-9827-39fda54cc971 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:38:12.436603 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-37b9b8d8-fd6e-47e5-9827-39fda54cc971 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] [instance: d5f46b70-ff39-46b9-912c-206b0683ed70] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:38:12.437867 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [req-655bf7f3-c828-41fc-aa5e-343fbf2217e0 req-4ad9dc51-06ab-47a2-b3da-cb954c97c6a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5f46b70-ff39-46b9-912c-206b0683ed70", "tag": "66167132-c1b5-4c9b-983f-cc21fd90ca2e"}]} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:38:12.439758 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:38:12.439758 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: warnings.warn(msg) Jan 18 16:38:12.444018 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-37b9b8d8-fd6e-47e5-9827-39fda54cc971 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:12.444523 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-37b9b8d8-fd6e-47e5-9827-39fda54cc971 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:12.445412 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-37b9b8d8-fd6e-47e5-9827-39fda54cc971 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:12.446057 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-37b9b8d8-fd6e-47e5-9827-39fda54cc971 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:12.447956 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-655bf7f3-c828-41fc-aa5e-343fbf2217e0 req-4ad9dc51-06ab-47a2-b3da-cb954c97c6a9 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:12.448404 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-655bf7f3-c828-41fc-aa5e-343fbf2217e0 req-4ad9dc51-06ab-47a2-b3da-cb954c97c6a9 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:12.460693 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.compute.server_external_events [req-655bf7f3-c828-41fc-aa5e-343fbf2217e0 req-4ad9dc51-06ab-47a2-b3da-cb954c97c6a9 service nova] Creating event network-changed:66167132-c1b5-4c9b-983f-cc21fd90ca2e for instance d5f46b70-ff39-46b9-912c-206b0683ed70 on hv-cinder-78836 Jan 18 16:38:12.465640 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [req-655bf7f3-c828-41fc-aa5e-343fbf2217e0 req-4ad9dc51-06ab-47a2-b3da-cb954c97c6a9 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031606 Jan 18 16:38:12.466482 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 473/938] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:38:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:38:12.473980 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-37b9b8d8-fd6e-47e5-9827-39fda54cc971 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] [instance: d5f46b70-ff39-46b9-912c-206b0683ed70] Going to try to terminate instance {{(pid=116368) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 18 16:38:12.557135 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-37b9b8d8-fd6e-47e5-9827-39fda54cc971 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] 10.222.0.82 "DELETE /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70" status: 204 len: 0 microversion: 2.1 time: 0.124742 Jan 18 16:38:12.561080 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 466/939] 10.222.0.82 () {58 vars in 1238 bytes} [Tue Jan 18 16:38:12 2022] DELETE /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 18 16:38:12.568164 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-35330936-5566-491d-a505-bf2212e9924b tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:38:12.568890 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-35330936-5566-491d-a505-bf2212e9924b tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] [instance: d5f46b70-ff39-46b9-912c-206b0683ed70] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:38:12.575942 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-35330936-5566-491d-a505-bf2212e9924b tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:12.576424 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-35330936-5566-491d-a505-bf2212e9924b tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:12.577244 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-35330936-5566-491d-a505-bf2212e9924b tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:12.577671 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-35330936-5566-491d-a505-bf2212e9924b tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:12.796731 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-35330936-5566-491d-a505-bf2212e9924b tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2d1245fe3f4bf596e1c0f6978e34bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b7bab53ef4d6e869362551b3cfb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:38:12.804173 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-35330936-5566-491d-a505-bf2212e9924b tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] 10.222.0.82 "GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70" status: 200 len: 1567 microversion: 2.1 time: 0.241405 Jan 18 16:38:12.807820 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 474/940] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:38:12 2022] GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70 => generated 1567 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:38:12.879392 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-83b83796-3e52-4960-b58b-fab6e7fdc2ce tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:38:12.880421 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-83b83796-3e52-4960-b58b-fab6e7fdc2ce tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:38:12.888730 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-83b83796-3e52-4960-b58b-fab6e7fdc2ce tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:12.889562 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-83b83796-3e52-4960-b58b-fab6e7fdc2ce tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:12.890760 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-83b83796-3e52-4960-b58b-fab6e7fdc2ce tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:12.891202 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-83b83796-3e52-4960-b58b-fab6e7fdc2ce tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:12.965877 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-83b83796-3e52-4960-b58b-fab6e7fdc2ce tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action" status: 200 len: 28663 microversion: 2.1 time: 0.090600 Jan 18 16:38:12.966956 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 467/941] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:38:12 2022] POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action => generated 28663 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:38:13.822290 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-51b10ed4-bdc8-49f7-82b6-de40026d9488 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:38:13.823508 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-51b10ed4-bdc8-49f7-82b6-de40026d9488 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] [instance: d5f46b70-ff39-46b9-912c-206b0683ed70] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:38:13.829784 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-51b10ed4-bdc8-49f7-82b6-de40026d9488 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:13.830225 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-51b10ed4-bdc8-49f7-82b6-de40026d9488 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:13.830996 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-51b10ed4-bdc8-49f7-82b6-de40026d9488 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:13.831420 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-51b10ed4-bdc8-49f7-82b6-de40026d9488 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:13.964947 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-51b10ed4-bdc8-49f7-82b6-de40026d9488 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2d1245fe3f4bf596e1c0f6978e34bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b7bab53ef4d6e869362551b3cfb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:38:13.972339 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-51b10ed4-bdc8-49f7-82b6-de40026d9488 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] 10.222.0.82 "GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70" status: 200 len: 1449 microversion: 2.1 time: 0.153734 Jan 18 16:38:13.972910 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 475/942] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:38:13 2022] GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:38:13.979278 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-582c32a8-3e81-4862-8b06-eccd65f8cc74 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:38:13.980278 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-582c32a8-3e81-4862-8b06-eccd65f8cc74 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:38:13.987260 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-582c32a8-3e81-4862-8b06-eccd65f8cc74 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:13.987714 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-582c32a8-3e81-4862-8b06-eccd65f8cc74 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:13.988500 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-582c32a8-3e81-4862-8b06-eccd65f8cc74 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:13.989141 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-582c32a8-3e81-4862-8b06-eccd65f8cc74 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:14.077651 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-582c32a8-3e81-4862-8b06-eccd65f8cc74 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action" status: 200 len: 28816 microversion: 2.1 time: 0.102947 Jan 18 16:38:14.078254 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 468/943] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:38:13 2022] POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action => generated 28816 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:38:14.797608 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [req-cda977f1-769e-4587-9e49-f6343fcf814d req-5dae2e1d-3bec-4739-8f1f-f14153480443 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5f46b70-ff39-46b9-912c-206b0683ed70", "name": "network-vif-deleted", "tag": "66167132-c1b5-4c9b-983f-cc21fd90ca2e"}]} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:38:14.799413 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:38:14.799413 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: warnings.warn(msg) Jan 18 16:38:14.808483 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-cda977f1-769e-4587-9e49-f6343fcf814d req-5dae2e1d-3bec-4739-8f1f-f14153480443 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:14.808936 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-cda977f1-769e-4587-9e49-f6343fcf814d req-5dae2e1d-3bec-4739-8f1f-f14153480443 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:14.821691 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.compute.server_external_events [req-cda977f1-769e-4587-9e49-f6343fcf814d req-5dae2e1d-3bec-4739-8f1f-f14153480443 service nova] Creating event network-vif-deleted:66167132-c1b5-4c9b-983f-cc21fd90ca2e for instance d5f46b70-ff39-46b9-912c-206b0683ed70 on hv-cinder-78836 Jan 18 16:38:14.827578 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [req-cda977f1-769e-4587-9e49-f6343fcf814d req-5dae2e1d-3bec-4739-8f1f-f14153480443 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033557 Jan 18 16:38:14.828354 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 476/944] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:38:14.990006 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-3c216b19-4dc8-427d-9fde-4719aa7ae37d tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:38:14.990625 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-3c216b19-4dc8-427d-9fde-4719aa7ae37d tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] [instance: d5f46b70-ff39-46b9-912c-206b0683ed70] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:38:14.997997 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3c216b19-4dc8-427d-9fde-4719aa7ae37d tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:14.998659 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3c216b19-4dc8-427d-9fde-4719aa7ae37d tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:14.999437 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3c216b19-4dc8-427d-9fde-4719aa7ae37d tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:14.999875 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3c216b19-4dc8-427d-9fde-4719aa7ae37d tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:15.065191 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-3c216b19-4dc8-427d-9fde-4719aa7ae37d tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2d1245fe3f4bf596e1c0f6978e34bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b7bab53ef4d6e869362551b3cfb6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:38:15.074316 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-3c216b19-4dc8-427d-9fde-4719aa7ae37d tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] 10.222.0.82 "GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70" status: 200 len: 1218 microversion: 2.1 time: 0.088378 Jan 18 16:38:15.074898 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 469/945] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:38:14 2022] GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:38:15.089797 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-30ffb2b7-bd49-460b-8c57-1e69db9cb00d tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:38:15.090801 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-30ffb2b7-bd49-460b-8c57-1e69db9cb00d tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:38:15.097336 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-30ffb2b7-bd49-460b-8c57-1e69db9cb00d tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:15.097787 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-30ffb2b7-bd49-460b-8c57-1e69db9cb00d tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:15.098656 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-30ffb2b7-bd49-460b-8c57-1e69db9cb00d tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:15.099023 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-30ffb2b7-bd49-460b-8c57-1e69db9cb00d tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:15.182114 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-30ffb2b7-bd49-460b-8c57-1e69db9cb00d tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action" status: 200 len: 30576 microversion: 2.1 time: 0.096359 Jan 18 16:38:15.182769 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 477/946] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:38:15 2022] POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action => generated 30576 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:38:16.090091 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-acdcb6f8-72aa-4272-baf8-e343df880c84 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:38:16.090718 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-acdcb6f8-72aa-4272-baf8-e343df880c84 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] [instance: d5f46b70-ff39-46b9-912c-206b0683ed70] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:38:16.096860 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-acdcb6f8-72aa-4272-baf8-e343df880c84 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:16.097325 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-acdcb6f8-72aa-4272-baf8-e343df880c84 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:16.098091 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-acdcb6f8-72aa-4272-baf8-e343df880c84 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:16.098511 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-acdcb6f8-72aa-4272-baf8-e343df880c84 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:16.111896 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.wsgi [None req-acdcb6f8-72aa-4272-baf8-e343df880c84 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] HTTP exception thrown: Instance d5f46b70-ff39-46b9-912c-206b0683ed70 could not be found. Jan 18 16:38:16.112646 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-acdcb6f8-72aa-4272-baf8-e343df880c84 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Returning 404 to user: Instance d5f46b70-ff39-46b9-912c-206b0683ed70 could not be found. {{(pid=116368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 16:38:16.113479 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-acdcb6f8-72aa-4272-baf8-e343df880c84 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] 10.222.0.82 "GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70" status: 404 len: 111 microversion: 2.1 time: 0.027047 Jan 18 16:38:16.113993 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 470/947] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:38:16 2022] GET /compute/v2.1/servers/d5f46b70-ff39-46b9-912c-206b0683ed70 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 16:38:16.194309 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-be322617-d624-4a7a-9ed7-c70a424867cc tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:38:16.195307 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-be322617-d624-4a7a-9ed7-c70a424867cc tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:38:16.202078 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-be322617-d624-4a7a-9ed7-c70a424867cc tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:16.202532 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-be322617-d624-4a7a-9ed7-c70a424867cc tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:16.203318 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-be322617-d624-4a7a-9ed7-c70a424867cc tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:16.203755 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-be322617-d624-4a7a-9ed7-c70a424867cc tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:16.274167 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-84eae96a-4d52-48e3-bbfb-7b48646ade62 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] Calling method '.version_select at 0x7f33a9595550>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:38:16.288973 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-be322617-d624-4a7a-9ed7-c70a424867cc tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action" status: 200 len: 32231 microversion: 2.1 time: 0.099235 Jan 18 16:38:16.291677 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 478/948] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:38:16 2022] POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action => generated 32231 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:38:16.293276 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-84eae96a-4d52-48e3-bbfb-7b48646ade62 tempest-TestShelveInstance-877361262 tempest-TestShelveInstance-877361262-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-248830851" status: 202 len: 0 microversion: 2.1 time: 0.023224 Jan 18 16:38:16.294365 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 471/949] 10.222.0.82 () {58 vars in 1250 bytes} [Tue Jan 18 16:38:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-248830851 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 18 16:38:17.303406 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-9245f634-f228-4b69-a708-ce3ef9a3909e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:38:17.304409 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-9245f634-f228-4b69-a708-ce3ef9a3909e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:38:17.311537 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-9245f634-f228-4b69-a708-ce3ef9a3909e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:17.311983 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-9245f634-f228-4b69-a708-ce3ef9a3909e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:17.312770 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-9245f634-f228-4b69-a708-ce3ef9a3909e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:17.313276 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-9245f634-f228-4b69-a708-ce3ef9a3909e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:17.395650 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-9245f634-f228-4b69-a708-ce3ef9a3909e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action" status: 200 len: 33476 microversion: 2.1 time: 0.096614 Jan 18 16:38:17.399955 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 479/950] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:38:17 2022] POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action => generated 33476 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:38:18.408096 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-2f6fb4d3-9731-4cd1-8ac5-4f8b5cebe177 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:38:18.409124 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-2f6fb4d3-9731-4cd1-8ac5-4f8b5cebe177 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:38:18.417764 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-2f6fb4d3-9731-4cd1-8ac5-4f8b5cebe177 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:18.418220 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-2f6fb4d3-9731-4cd1-8ac5-4f8b5cebe177 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:18.419022 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-2f6fb4d3-9731-4cd1-8ac5-4f8b5cebe177 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:18.419521 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-2f6fb4d3-9731-4cd1-8ac5-4f8b5cebe177 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:18.510873 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-2f6fb4d3-9731-4cd1-8ac5-4f8b5cebe177 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action" status: 200 len: 34174 microversion: 2.1 time: 0.106548 Jan 18 16:38:18.512431 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 472/951] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:38:18 2022] POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action => generated 34174 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 18 16:38:19.524796 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-7d67803a-71a1-4725-8677-c6dbecab6805 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:38:19.525828 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-7d67803a-71a1-4725-8677-c6dbecab6805 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:38:19.541220 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7d67803a-71a1-4725-8677-c6dbecab6805 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:19.541660 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7d67803a-71a1-4725-8677-c6dbecab6805 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:19.542451 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7d67803a-71a1-4725-8677-c6dbecab6805 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:19.542879 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7d67803a-71a1-4725-8677-c6dbecab6805 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:19.629262 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-7d67803a-71a1-4725-8677-c6dbecab6805 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action" status: 200 len: 35014 microversion: 2.1 time: 0.108951 Jan 18 16:38:19.633038 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 480/952] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:38:19 2022] POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action => generated 35014 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:38:20.641665 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-f5a5d19d-617a-45a3-af40-a3e1cc6b0544 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:38:20.642660 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-f5a5d19d-617a-45a3-af40-a3e1cc6b0544 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:38:20.649829 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f5a5d19d-617a-45a3-af40-a3e1cc6b0544 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:20.650280 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f5a5d19d-617a-45a3-af40-a3e1cc6b0544 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:20.651072 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f5a5d19d-617a-45a3-af40-a3e1cc6b0544 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:20.651506 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f5a5d19d-617a-45a3-af40-a3e1cc6b0544 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:20.726744 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-f5a5d19d-617a-45a3-af40-a3e1cc6b0544 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action" status: 200 len: 36293 microversion: 2.1 time: 0.088876 Jan 18 16:38:20.727286 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 473/953] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:38:20 2022] POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action => generated 36293 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:38:21.738543 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-2502fc95-723b-41c7-bf89-7868caa226ab tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:38:21.739537 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-2502fc95-723b-41c7-bf89-7868caa226ab tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:38:21.747000 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2502fc95-723b-41c7-bf89-7868caa226ab tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:21.747444 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2502fc95-723b-41c7-bf89-7868caa226ab tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:21.748231 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2502fc95-723b-41c7-bf89-7868caa226ab tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:21.748663 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2502fc95-723b-41c7-bf89-7868caa226ab tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:21.823678 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-2502fc95-723b-41c7-bf89-7868caa226ab tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action" status: 200 len: 37769 microversion: 2.1 time: 0.088982 Jan 18 16:38:21.824578 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 481/954] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:38:21 2022] POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action => generated 37769 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 18 16:38:22.837383 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-572a081d-cc0d-4ff0-bcc1-60a4b276cecb tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:38:22.849323 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-572a081d-cc0d-4ff0-bcc1-60a4b276cecb tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:38:22.858725 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-572a081d-cc0d-4ff0-bcc1-60a4b276cecb tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:22.859245 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-572a081d-cc0d-4ff0-bcc1-60a4b276cecb tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:22.860043 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-572a081d-cc0d-4ff0-bcc1-60a4b276cecb tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:22.860477 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-572a081d-cc0d-4ff0-bcc1-60a4b276cecb tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:22.937963 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-572a081d-cc0d-4ff0-bcc1-60a4b276cecb tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action" status: 200 len: 38195 microversion: 2.1 time: 0.105604 Jan 18 16:38:22.938698 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 474/955] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:38:22 2022] POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action => generated 38195 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:38:23.950633 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-85194ad0-01e2-4472-8ee1-7dd71ff71776 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:38:23.951618 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-85194ad0-01e2-4472-8ee1-7dd71ff71776 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:38:23.959207 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-85194ad0-01e2-4472-8ee1-7dd71ff71776 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:23.959724 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-85194ad0-01e2-4472-8ee1-7dd71ff71776 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:23.960499 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-85194ad0-01e2-4472-8ee1-7dd71ff71776 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:23.960957 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-85194ad0-01e2-4472-8ee1-7dd71ff71776 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:24.029647 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-85194ad0-01e2-4472-8ee1-7dd71ff71776 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action" status: 200 len: 38195 microversion: 2.1 time: 0.082840 Jan 18 16:38:24.030318 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 482/956] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:38:23 2022] POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action => generated 38195 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:38:25.041966 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-377971b0-ed38-4ec4-83f0-31f7f339aa3f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:38:25.042985 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-377971b0-ed38-4ec4-83f0-31f7f339aa3f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:38:25.049812 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-377971b0-ed38-4ec4-83f0-31f7f339aa3f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:25.050264 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-377971b0-ed38-4ec4-83f0-31f7f339aa3f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:25.051072 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-377971b0-ed38-4ec4-83f0-31f7f339aa3f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:25.051534 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-377971b0-ed38-4ec4-83f0-31f7f339aa3f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:25.115810 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-377971b0-ed38-4ec4-83f0-31f7f339aa3f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action" status: 200 len: 38195 microversion: 2.1 time: 0.077702 Jan 18 16:38:25.116450 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 475/957] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:38:25 2022] POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action => generated 38195 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:38:26.127983 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-8e48002d-87bd-47c4-89a7-e9289858fdac tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:38:26.129080 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-8e48002d-87bd-47c4-89a7-e9289858fdac tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:38:26.135946 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-8e48002d-87bd-47c4-89a7-e9289858fdac tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:26.136400 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-8e48002d-87bd-47c4-89a7-e9289858fdac tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:26.137223 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-8e48002d-87bd-47c4-89a7-e9289858fdac tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:26.137658 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-8e48002d-87bd-47c4-89a7-e9289858fdac tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:26.208121 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-8e48002d-87bd-47c4-89a7-e9289858fdac tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action" status: 200 len: 38326 microversion: 2.1 time: 0.084073 Jan 18 16:38:26.209290 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 483/958] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:38:26 2022] POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action => generated 38326 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:38:26.219951 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-0c742f02-0c1f-4918-bc96-9a07d2baef2f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:38:26.220476 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-0c742f02-0c1f-4918-bc96-9a07d2baef2f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:38:26.228373 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0c742f02-0c1f-4918-bc96-9a07d2baef2f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:26.228825 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0c742f02-0c1f-4918-bc96-9a07d2baef2f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:26.229668 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0c742f02-0c1f-4918-bc96-9a07d2baef2f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:26.230107 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0c742f02-0c1f-4918-bc96-9a07d2baef2f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:26.253841 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-0c742f02-0c1f-4918-bc96-9a07d2baef2f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/ips" status: 200 len: 146 microversion: 2.1 time: 0.038101 Jan 18 16:38:26.254416 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 476/959] 10.222.0.82 () {58 vars in 1247 bytes} [Tue Jan 18 16:38:26 2022] GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:38:28.456239 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-e8c1ed5e-7778-4b76-96d7-ebcf50f3e7c2 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "00cfa858-0a63-441c-a6c3-bf10e118b56b"}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:38:28.457446 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-e8c1ed5e-7778-4b76-96d7-ebcf50f3e7c2 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:38:28.464581 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e8c1ed5e-7778-4b76-96d7-ebcf50f3e7c2 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:28.465053 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e8c1ed5e-7778-4b76-96d7-ebcf50f3e7c2 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:28.465865 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e8c1ed5e-7778-4b76-96d7-ebcf50f3e7c2 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:28.466334 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e8c1ed5e-7778-4b76-96d7-ebcf50f3e7c2 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:28.689207 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-e8c1ed5e-7778-4b76-96d7-ebcf50f3e7c2 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.236788 Jan 18 16:38:28.689861 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 484/960] 10.222.0.82 () {60 vars in 1322 bytes} [Tue Jan 18 16:38:28 2022] POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/os-volume_attachments => generated 194 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:38:35.103344 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-7ec6c541-1c5d-4f0a-9ad5-5fdb59f5f77d tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:38:35.109600 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7ec6c541-1c5d-4f0a-9ad5-5fdb59f5f77d tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:35.110038 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7ec6c541-1c5d-4f0a-9ad5-5fdb59f5f77d tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:35.317252 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-7ec6c541-1c5d-4f0a-9ad5-5fdb59f5f77d tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Going to try to stop instance {{(pid=116368) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 18 16:38:35.358794 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-7ec6c541-1c5d-4f0a-9ad5-5fdb59f5f77d tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action" status: 202 len: 0 microversion: 2.1 time: 0.259197 Jan 18 16:38:35.359487 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 477/961] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:38:35 2022] POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:38:35.369196 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-673a50ad-e2f8-42b8-b8fd-c850a32a91ae tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:38:35.369940 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-673a50ad-e2f8-42b8-b8fd-c850a32a91ae tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:38:35.376878 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-673a50ad-e2f8-42b8-b8fd-c850a32a91ae tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:35.377459 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-673a50ad-e2f8-42b8-b8fd-c850a32a91ae tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:35.378257 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-673a50ad-e2f8-42b8-b8fd-c850a32a91ae tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:35.378694 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-673a50ad-e2f8-42b8-b8fd-c850a32a91ae tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:35.515391 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-673a50ad-e2f8-42b8-b8fd-c850a32a91ae tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:38:35.523076 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-673a50ad-e2f8-42b8-b8fd-c850a32a91ae tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515" status: 200 len: 1724 microversion: 2.1 time: 0.158688 Jan 18 16:38:35.523648 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 485/962] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:38:35 2022] GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:38:36.541183 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-37006b31-3d18-443d-ba73-ddd5649ed278 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:38:36.541787 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-37006b31-3d18-443d-ba73-ddd5649ed278 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:38:36.548325 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-37006b31-3d18-443d-ba73-ddd5649ed278 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:36.548765 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-37006b31-3d18-443d-ba73-ddd5649ed278 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:36.549554 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-37006b31-3d18-443d-ba73-ddd5649ed278 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:36.549979 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-37006b31-3d18-443d-ba73-ddd5649ed278 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:36.681178 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-37006b31-3d18-443d-ba73-ddd5649ed278 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:38:36.689122 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-37006b31-3d18-443d-ba73-ddd5649ed278 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515" status: 200 len: 1724 microversion: 2.1 time: 0.152597 Jan 18 16:38:36.689740 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 478/963] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:38:36 2022] GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:38:37.707652 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-bccd7e7c-7942-4ae4-88f0-77984feeac43 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:38:37.708257 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-bccd7e7c-7942-4ae4-88f0-77984feeac43 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:38:37.724599 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-bccd7e7c-7942-4ae4-88f0-77984feeac43 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:37.725081 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-bccd7e7c-7942-4ae4-88f0-77984feeac43 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:37.725858 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-bccd7e7c-7942-4ae4-88f0-77984feeac43 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:37.726292 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-bccd7e7c-7942-4ae4-88f0-77984feeac43 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:37.863138 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-bccd7e7c-7942-4ae4-88f0-77984feeac43 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:38:37.871646 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-bccd7e7c-7942-4ae4-88f0-77984feeac43 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515" status: 200 len: 1724 microversion: 2.1 time: 0.167634 Jan 18 16:38:37.872219 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 486/964] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:38:37 2022] GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:38:38.887767 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-efd0bc37-aef1-4282-a959-6c1d652ef6a9 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:38:38.888383 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-efd0bc37-aef1-4282-a959-6c1d652ef6a9 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:38:38.894557 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-efd0bc37-aef1-4282-a959-6c1d652ef6a9 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:38.895005 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-efd0bc37-aef1-4282-a959-6c1d652ef6a9 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:38.895772 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-efd0bc37-aef1-4282-a959-6c1d652ef6a9 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:38.896206 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-efd0bc37-aef1-4282-a959-6c1d652ef6a9 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:39.026334 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-efd0bc37-aef1-4282-a959-6c1d652ef6a9 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:38:39.033890 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-efd0bc37-aef1-4282-a959-6c1d652ef6a9 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515" status: 200 len: 1724 microversion: 2.1 time: 0.149878 Jan 18 16:38:39.034447 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 479/965] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:38:38 2022] GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:38:40.051103 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-72c68521-fddc-46a0-81bb-c823349f35ac tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:38:40.051693 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-72c68521-fddc-46a0-81bb-c823349f35ac tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:38:40.058396 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-72c68521-fddc-46a0-81bb-c823349f35ac tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:40.058838 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-72c68521-fddc-46a0-81bb-c823349f35ac tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:40.059602 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-72c68521-fddc-46a0-81bb-c823349f35ac tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:40.060030 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-72c68521-fddc-46a0-81bb-c823349f35ac tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:40.187270 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-72c68521-fddc-46a0-81bb-c823349f35ac tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:38:40.195823 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-72c68521-fddc-46a0-81bb-c823349f35ac tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515" status: 200 len: 1724 microversion: 2.1 time: 0.148408 Jan 18 16:38:40.196390 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 487/966] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:38:40 2022] GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:38:41.213583 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-be63ade5-b1a1-4e3a-8fe5-a74de2002fc6 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:38:41.214280 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-be63ade5-b1a1-4e3a-8fe5-a74de2002fc6 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:38:41.220505 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-be63ade5-b1a1-4e3a-8fe5-a74de2002fc6 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:41.220971 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-be63ade5-b1a1-4e3a-8fe5-a74de2002fc6 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:41.221747 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-be63ade5-b1a1-4e3a-8fe5-a74de2002fc6 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:41.222173 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-be63ade5-b1a1-4e3a-8fe5-a74de2002fc6 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:41.352979 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-be63ade5-b1a1-4e3a-8fe5-a74de2002fc6 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:38:41.360639 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-be63ade5-b1a1-4e3a-8fe5-a74de2002fc6 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515" status: 200 len: 1724 microversion: 2.1 time: 0.150721 Jan 18 16:38:41.361236 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 480/967] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:38:41 2022] GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:38:42.377412 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-54fac5b1-9858-42f6-9047-92b828c68705 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:38:42.378010 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-54fac5b1-9858-42f6-9047-92b828c68705 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:38:42.384133 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-54fac5b1-9858-42f6-9047-92b828c68705 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:42.384581 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-54fac5b1-9858-42f6-9047-92b828c68705 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:42.385379 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-54fac5b1-9858-42f6-9047-92b828c68705 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:42.385807 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-54fac5b1-9858-42f6-9047-92b828c68705 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:42.513996 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-54fac5b1-9858-42f6-9047-92b828c68705 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:38:42.522532 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-54fac5b1-9858-42f6-9047-92b828c68705 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515" status: 200 len: 1724 microversion: 2.1 time: 0.148809 Jan 18 16:38:42.523551 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 488/968] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:38:42 2022] GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:38:43.539977 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-f7be55ff-a338-413e-bc5b-866eb71f6266 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:38:43.540525 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-f7be55ff-a338-413e-bc5b-866eb71f6266 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:38:43.546793 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f7be55ff-a338-413e-bc5b-866eb71f6266 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:43.547241 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f7be55ff-a338-413e-bc5b-866eb71f6266 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:43.548016 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f7be55ff-a338-413e-bc5b-866eb71f6266 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:43.548447 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f7be55ff-a338-413e-bc5b-866eb71f6266 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:43.678462 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-f7be55ff-a338-413e-bc5b-866eb71f6266 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:38:43.686371 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-f7be55ff-a338-413e-bc5b-866eb71f6266 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515" status: 200 len: 1724 microversion: 2.1 time: 0.150694 Jan 18 16:38:43.686930 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 481/969] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:38:43 2022] GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:38:44.703348 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-95f63cce-febd-4eea-9e10-911d8fe12cb6 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:38:44.703996 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-95f63cce-febd-4eea-9e10-911d8fe12cb6 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:38:44.710988 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-95f63cce-febd-4eea-9e10-911d8fe12cb6 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:44.711434 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-95f63cce-febd-4eea-9e10-911d8fe12cb6 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:44.712208 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-95f63cce-febd-4eea-9e10-911d8fe12cb6 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:44.712644 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-95f63cce-febd-4eea-9e10-911d8fe12cb6 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:44.853383 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-95f63cce-febd-4eea-9e10-911d8fe12cb6 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:38:44.861045 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-95f63cce-febd-4eea-9e10-911d8fe12cb6 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515" status: 200 len: 1724 microversion: 2.1 time: 0.161376 Jan 18 16:38:44.861609 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 489/970] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:38:44 2022] GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:38:45.877349 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-c3ce4183-5adf-4a28-b329-efd3f7a59385 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:38:45.877962 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-c3ce4183-5adf-4a28-b329-efd3f7a59385 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:38:45.884994 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c3ce4183-5adf-4a28-b329-efd3f7a59385 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:45.885448 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c3ce4183-5adf-4a28-b329-efd3f7a59385 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:45.886232 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c3ce4183-5adf-4a28-b329-efd3f7a59385 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:45.886670 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c3ce4183-5adf-4a28-b329-efd3f7a59385 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:46.012611 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-c3ce4183-5adf-4a28-b329-efd3f7a59385 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:38:46.020289 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-c3ce4183-5adf-4a28-b329-efd3f7a59385 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515" status: 200 len: 1724 microversion: 2.1 time: 0.146578 Jan 18 16:38:46.020856 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 482/971] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:38:45 2022] GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515 => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:38:47.037858 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-14e4eacc-ac06-4cab-bc00-2333f35e1f86 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:38:47.038474 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-14e4eacc-ac06-4cab-bc00-2333f35e1f86 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:38:47.044820 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-14e4eacc-ac06-4cab-bc00-2333f35e1f86 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:47.045306 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-14e4eacc-ac06-4cab-bc00-2333f35e1f86 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:47.046085 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-14e4eacc-ac06-4cab-bc00-2333f35e1f86 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:47.046518 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-14e4eacc-ac06-4cab-bc00-2333f35e1f86 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:47.177007 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-14e4eacc-ac06-4cab-bc00-2333f35e1f86 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:38:47.185200 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-14e4eacc-ac06-4cab-bc00-2333f35e1f86 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515" status: 200 len: 1724 microversion: 2.1 time: 0.151664 Jan 18 16:38:47.185765 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 490/972] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:38:47 2022] GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:38:48.202548 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-99e14eb0-4321-402f-b8f1-b40e00356f92 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:38:48.203160 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-99e14eb0-4321-402f-b8f1-b40e00356f92 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:38:48.209537 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-99e14eb0-4321-402f-b8f1-b40e00356f92 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:48.210045 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-99e14eb0-4321-402f-b8f1-b40e00356f92 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:48.211191 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-99e14eb0-4321-402f-b8f1-b40e00356f92 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:48.211937 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-99e14eb0-4321-402f-b8f1-b40e00356f92 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:48.344077 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-99e14eb0-4321-402f-b8f1-b40e00356f92 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:38:48.351861 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-99e14eb0-4321-402f-b8f1-b40e00356f92 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515" status: 200 len: 1724 microversion: 2.1 time: 0.153003 Jan 18 16:38:48.352428 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 483/973] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:38:48 2022] GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:38:49.368715 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-875af81c-6d19-4072-94f5-4888f9b9bc02 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:38:49.369354 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-875af81c-6d19-4072-94f5-4888f9b9bc02 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:38:49.375619 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-875af81c-6d19-4072-94f5-4888f9b9bc02 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:49.376072 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-875af81c-6d19-4072-94f5-4888f9b9bc02 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:49.376853 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-875af81c-6d19-4072-94f5-4888f9b9bc02 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:49.377318 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-875af81c-6d19-4072-94f5-4888f9b9bc02 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:49.503915 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-875af81c-6d19-4072-94f5-4888f9b9bc02 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:38:49.512663 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-875af81c-6d19-4072-94f5-4888f9b9bc02 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515" status: 200 len: 1724 microversion: 2.1 time: 0.148063 Jan 18 16:38:49.513456 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 491/974] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:38:49 2022] GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515 => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:38:50.530446 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-17efa3a0-1df4-4a28-a37a-06ee0421fa9d tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:38:50.531004 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-17efa3a0-1df4-4a28-a37a-06ee0421fa9d tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:38:50.538111 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-17efa3a0-1df4-4a28-a37a-06ee0421fa9d tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:50.538551 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-17efa3a0-1df4-4a28-a37a-06ee0421fa9d tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:50.539316 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-17efa3a0-1df4-4a28-a37a-06ee0421fa9d tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:50.539743 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-17efa3a0-1df4-4a28-a37a-06ee0421fa9d tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:50.671803 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-17efa3a0-1df4-4a28-a37a-06ee0421fa9d tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:38:50.680553 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-17efa3a0-1df4-4a28-a37a-06ee0421fa9d tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515" status: 200 len: 1724 microversion: 2.1 time: 0.153908 Jan 18 16:38:50.681151 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 484/975] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:38:50 2022] GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:38:51.698161 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-a559dca9-3559-430c-9b11-94f43ed91971 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:38:51.698770 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-a559dca9-3559-430c-9b11-94f43ed91971 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:38:51.705026 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a559dca9-3559-430c-9b11-94f43ed91971 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:51.705479 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a559dca9-3559-430c-9b11-94f43ed91971 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:51.706253 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a559dca9-3559-430c-9b11-94f43ed91971 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:51.706684 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a559dca9-3559-430c-9b11-94f43ed91971 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:51.834162 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-a559dca9-3559-430c-9b11-94f43ed91971 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:38:51.841876 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-a559dca9-3559-430c-9b11-94f43ed91971 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515" status: 200 len: 1724 microversion: 2.1 time: 0.147361 Jan 18 16:38:51.842452 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 492/976] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:38:51 2022] GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:38:52.857971 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-ef100576-e947-4d1c-9221-0d55c5b62d92 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:38:52.858577 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-ef100576-e947-4d1c-9221-0d55c5b62d92 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:38:52.870182 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ef100576-e947-4d1c-9221-0d55c5b62d92 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:52.870641 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ef100576-e947-4d1c-9221-0d55c5b62d92 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:52.871430 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ef100576-e947-4d1c-9221-0d55c5b62d92 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:52.871871 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ef100576-e947-4d1c-9221-0d55c5b62d92 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:53.001292 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-ef100576-e947-4d1c-9221-0d55c5b62d92 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:38:53.009455 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-ef100576-e947-4d1c-9221-0d55c5b62d92 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515" status: 200 len: 1724 microversion: 2.1 time: 0.155109 Jan 18 16:38:53.010027 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 485/977] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:38:52 2022] GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:38:54.026086 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-b7c2a562-13d8-49f2-bf5d-da37b7a795cc tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:38:54.026725 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-b7c2a562-13d8-49f2-bf5d-da37b7a795cc tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:38:54.032932 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-b7c2a562-13d8-49f2-bf5d-da37b7a795cc tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:54.033392 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-b7c2a562-13d8-49f2-bf5d-da37b7a795cc tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:54.034173 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-b7c2a562-13d8-49f2-bf5d-da37b7a795cc tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:54.034613 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-b7c2a562-13d8-49f2-bf5d-da37b7a795cc tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:54.169901 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-b7c2a562-13d8-49f2-bf5d-da37b7a795cc tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:38:54.178175 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-b7c2a562-13d8-49f2-bf5d-da37b7a795cc tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515" status: 200 len: 1724 microversion: 2.1 time: 0.155793 Jan 18 16:38:54.178743 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 493/978] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:38:54 2022] GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:38:55.195197 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-c179fe9b-f18b-4c15-9da1-d5b47f4bdcf7 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:38:55.195789 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-c179fe9b-f18b-4c15-9da1-d5b47f4bdcf7 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:38:55.202037 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c179fe9b-f18b-4c15-9da1-d5b47f4bdcf7 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:55.202488 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c179fe9b-f18b-4c15-9da1-d5b47f4bdcf7 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:55.203266 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c179fe9b-f18b-4c15-9da1-d5b47f4bdcf7 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:55.203703 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c179fe9b-f18b-4c15-9da1-d5b47f4bdcf7 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:55.339361 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-c179fe9b-f18b-4c15-9da1-d5b47f4bdcf7 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:38:55.346973 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-c179fe9b-f18b-4c15-9da1-d5b47f4bdcf7 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515" status: 200 len: 1724 microversion: 2.1 time: 0.155808 Jan 18 16:38:55.347536 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 486/979] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:38:55 2022] GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:38:56.365061 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-a13fe0cb-9180-4611-8be3-df4b431ff45f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:38:56.365869 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-a13fe0cb-9180-4611-8be3-df4b431ff45f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:38:56.372072 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a13fe0cb-9180-4611-8be3-df4b431ff45f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:56.372522 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a13fe0cb-9180-4611-8be3-df4b431ff45f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:56.373326 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a13fe0cb-9180-4611-8be3-df4b431ff45f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:56.373759 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a13fe0cb-9180-4611-8be3-df4b431ff45f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:56.504392 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-a13fe0cb-9180-4611-8be3-df4b431ff45f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:38:56.512100 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-a13fe0cb-9180-4611-8be3-df4b431ff45f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515" status: 200 len: 1701 microversion: 2.1 time: 0.151254 Jan 18 16:38:56.512670 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 494/980] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:38:56 2022] GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515 => generated 1701 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:38:56.527955 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-aa405a5f-b956-4cf7-8162-9606f993a668 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:38:56.534381 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-aa405a5f-b956-4cf7-8162-9606f993a668 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:56.534854 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-aa405a5f-b956-4cf7-8162-9606f993a668 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:56.558175 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-aa405a5f-b956-4cf7-8162-9606f993a668 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Going to try to start instance {{(pid=116368) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 18 16:38:56.597894 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-aa405a5f-b956-4cf7-8162-9606f993a668 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action" status: 202 len: 0 microversion: 2.1 time: 0.073547 Jan 18 16:38:56.598514 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 487/981] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:38:56 2022] POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:38:56.606912 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-2de85015-3ec5-454f-bcb6-f0616baad9e5 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:38:56.607635 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-2de85015-3ec5-454f-bcb6-f0616baad9e5 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:38:56.613465 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2de85015-3ec5-454f-bcb6-f0616baad9e5 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:56.613977 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2de85015-3ec5-454f-bcb6-f0616baad9e5 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:56.615561 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2de85015-3ec5-454f-bcb6-f0616baad9e5 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:56.615998 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2de85015-3ec5-454f-bcb6-f0616baad9e5 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:56.749903 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-2de85015-3ec5-454f-bcb6-f0616baad9e5 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:38:56.758242 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-2de85015-3ec5-454f-bcb6-f0616baad9e5 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515" status: 200 len: 1710 microversion: 2.1 time: 0.154965 Jan 18 16:38:56.758746 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 495/982] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:38:56 2022] GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515 => generated 1710 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:38:57.776071 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-bf6d33e2-30f9-4f12-8940-4b86820fe7b8 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:38:57.776770 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-bf6d33e2-30f9-4f12-8940-4b86820fe7b8 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:38:57.782819 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-bf6d33e2-30f9-4f12-8940-4b86820fe7b8 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:57.783268 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-bf6d33e2-30f9-4f12-8940-4b86820fe7b8 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:57.784047 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-bf6d33e2-30f9-4f12-8940-4b86820fe7b8 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:57.784490 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-bf6d33e2-30f9-4f12-8940-4b86820fe7b8 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:57.920900 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-bf6d33e2-30f9-4f12-8940-4b86820fe7b8 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:38:57.929284 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-bf6d33e2-30f9-4f12-8940-4b86820fe7b8 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515" status: 200 len: 1710 microversion: 2.1 time: 0.157639 Jan 18 16:38:57.929852 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 488/983] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:38:57 2022] GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515 => generated 1710 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:38:58.946968 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-231da10a-d099-4f80-82e8-ad3879aabde3 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:38:58.947566 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-231da10a-d099-4f80-82e8-ad3879aabde3 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:38:58.953841 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-231da10a-d099-4f80-82e8-ad3879aabde3 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:58.954283 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-231da10a-d099-4f80-82e8-ad3879aabde3 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:58.955050 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-231da10a-d099-4f80-82e8-ad3879aabde3 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:38:58.955481 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-231da10a-d099-4f80-82e8-ad3879aabde3 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:38:59.082407 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-231da10a-d099-4f80-82e8-ad3879aabde3 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:38:59.090268 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-231da10a-d099-4f80-82e8-ad3879aabde3 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515" status: 200 len: 1714 microversion: 2.1 time: 0.147527 Jan 18 16:38:59.090837 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 496/984] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:38:58 2022] GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515 => generated 1714 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:39:32.069224 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-e73b171f-3a39-4c8d-b301-d7d1504ed1bf tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:39:32.069794 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-e73b171f-3a39-4c8d-b301-d7d1504ed1bf tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:39:32.075517 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e73b171f-3a39-4c8d-b301-d7d1504ed1bf tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:39:32.075971 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e73b171f-3a39-4c8d-b301-d7d1504ed1bf tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:39:32.076755 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e73b171f-3a39-4c8d-b301-d7d1504ed1bf tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:39:32.077217 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e73b171f-3a39-4c8d-b301-d7d1504ed1bf tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:39:32.152945 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.objects.instance [None req-e73b171f-3a39-4c8d-b301-d7d1504ed1bf tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lazy-loading 'services' on Instance uuid 7c365b3e-1a90-40d6-8269-84bbf61e7515 {{(pid=116368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 18 16:39:32.220965 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-e73b171f-3a39-4c8d-b301-d7d1504ed1bf tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "DELETE /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/os-volume_attachments/00cfa858-0a63-441c-a6c3-bf10e118b56b" status: 202 len: 0 microversion: 2.1 time: 0.155989 Jan 18 16:39:32.221547 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 489/985] 10.222.0.82 () {58 vars in 1415 bytes} [Tue Jan 18 16:39:32 2022] DELETE /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/os-volume_attachments/00cfa858-0a63-441c-a6c3-bf10e118b56b => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:39:33.328275 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-0b06c0bb-c4b4-4b58-8e78-86ab53f1742a tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:39:33.335035 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0b06c0bb-c4b4-4b58-8e78-86ab53f1742a tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:39:33.335521 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0b06c0bb-c4b4-4b58-8e78-86ab53f1742a tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:39:33.394866 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-0b06c0bb-c4b4-4b58-8e78-86ab53f1742a tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Going to try to stop instance {{(pid=116367) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 18 16:39:33.438463 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-0b06c0bb-c4b4-4b58-8e78-86ab53f1742a tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action" status: 202 len: 0 microversion: 2.1 time: 0.113798 Jan 18 16:39:33.439199 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 497/986] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:39:33 2022] POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:39:33.449415 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-d94eb510-9671-4541-83f8-9cf2fc1f027e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:39:33.450216 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-d94eb510-9671-4541-83f8-9cf2fc1f027e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:39:33.456237 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d94eb510-9671-4541-83f8-9cf2fc1f027e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:39:33.456684 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d94eb510-9671-4541-83f8-9cf2fc1f027e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:39:33.457507 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d94eb510-9671-4541-83f8-9cf2fc1f027e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:39:33.457950 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d94eb510-9671-4541-83f8-9cf2fc1f027e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:39:33.592436 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-d94eb510-9671-4541-83f8-9cf2fc1f027e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:39:33.599818 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-d94eb510-9671-4541-83f8-9cf2fc1f027e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515" status: 200 len: 1678 microversion: 2.1 time: 0.156003 Jan 18 16:39:33.600467 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 490/987] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:39:33 2022] GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:39:34.617615 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-73b9b63d-e293-403e-a6ea-246711323cc2 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:39:34.618210 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-73b9b63d-e293-403e-a6ea-246711323cc2 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:39:34.624182 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-73b9b63d-e293-403e-a6ea-246711323cc2 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:39:34.624625 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-73b9b63d-e293-403e-a6ea-246711323cc2 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:39:34.625420 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-73b9b63d-e293-403e-a6ea-246711323cc2 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:39:34.625849 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-73b9b63d-e293-403e-a6ea-246711323cc2 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:39:34.762747 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-73b9b63d-e293-403e-a6ea-246711323cc2 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:39:34.770086 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-73b9b63d-e293-403e-a6ea-246711323cc2 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515" status: 200 len: 1678 microversion: 2.1 time: 0.156787 Jan 18 16:39:34.770664 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 498/988] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:39:34 2022] GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:39:35.790525 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-a727edb8-bd3c-4334-8995-24fd600d2d98 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:39:35.791132 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-a727edb8-bd3c-4334-8995-24fd600d2d98 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:39:35.797451 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a727edb8-bd3c-4334-8995-24fd600d2d98 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:39:35.797908 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a727edb8-bd3c-4334-8995-24fd600d2d98 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:39:35.798685 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a727edb8-bd3c-4334-8995-24fd600d2d98 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:39:35.799120 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a727edb8-bd3c-4334-8995-24fd600d2d98 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:39:35.926568 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-a727edb8-bd3c-4334-8995-24fd600d2d98 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:39:35.934085 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-a727edb8-bd3c-4334-8995-24fd600d2d98 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515" status: 200 len: 1678 microversion: 2.1 time: 0.147957 Jan 18 16:39:35.934638 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 491/989] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:39:35 2022] GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515 => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:39:36.952473 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-51012ea1-bc6b-4d20-aaaa-fb296a63182e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:39:36.953149 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-51012ea1-bc6b-4d20-aaaa-fb296a63182e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:39:36.959517 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-51012ea1-bc6b-4d20-aaaa-fb296a63182e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:39:36.959975 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-51012ea1-bc6b-4d20-aaaa-fb296a63182e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:39:36.960759 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-51012ea1-bc6b-4d20-aaaa-fb296a63182e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:39:36.961226 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-51012ea1-bc6b-4d20-aaaa-fb296a63182e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:39:37.091074 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-51012ea1-bc6b-4d20-aaaa-fb296a63182e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:39:37.098335 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-51012ea1-bc6b-4d20-aaaa-fb296a63182e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515" status: 200 len: 1678 microversion: 2.1 time: 0.149615 Jan 18 16:39:37.098906 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 499/990] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:39:36 2022] GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:39:38.116019 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-ab1e4fd3-361b-487d-af35-6feb2feb29ea tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:39:38.116620 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-ab1e4fd3-361b-487d-af35-6feb2feb29ea tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:39:38.122786 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ab1e4fd3-361b-487d-af35-6feb2feb29ea tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:39:38.123227 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ab1e4fd3-361b-487d-af35-6feb2feb29ea tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:39:38.123998 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ab1e4fd3-361b-487d-af35-6feb2feb29ea tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:39:38.124425 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ab1e4fd3-361b-487d-af35-6feb2feb29ea tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:39:38.253811 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-ab1e4fd3-361b-487d-af35-6feb2feb29ea tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:39:38.261942 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-ab1e4fd3-361b-487d-af35-6feb2feb29ea tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515" status: 200 len: 1678 microversion: 2.1 time: 0.150048 Jan 18 16:39:38.262516 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 492/991] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:39:38 2022] GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:39:39.278718 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-4f6b3054-a721-4806-9409-fe38e0fd6139 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:39:39.279331 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-4f6b3054-a721-4806-9409-fe38e0fd6139 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:39:39.285661 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4f6b3054-a721-4806-9409-fe38e0fd6139 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:39:39.286121 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4f6b3054-a721-4806-9409-fe38e0fd6139 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:39:39.286891 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4f6b3054-a721-4806-9409-fe38e0fd6139 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:39:39.287877 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4f6b3054-a721-4806-9409-fe38e0fd6139 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:39:39.417945 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-4f6b3054-a721-4806-9409-fe38e0fd6139 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:39:39.425320 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-4f6b3054-a721-4806-9409-fe38e0fd6139 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515" status: 200 len: 1678 microversion: 2.1 time: 0.150179 Jan 18 16:39:39.425902 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 500/992] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:39:39 2022] GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:39:40.442931 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-464423c9-94e9-4a9e-a918-ebf4f9bae1c8 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:39:40.444568 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-464423c9-94e9-4a9e-a918-ebf4f9bae1c8 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:39:40.450549 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-464423c9-94e9-4a9e-a918-ebf4f9bae1c8 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:39:40.450999 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-464423c9-94e9-4a9e-a918-ebf4f9bae1c8 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:39:40.451783 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-464423c9-94e9-4a9e-a918-ebf4f9bae1c8 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:39:40.452222 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-464423c9-94e9-4a9e-a918-ebf4f9bae1c8 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:39:40.589124 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-464423c9-94e9-4a9e-a918-ebf4f9bae1c8 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:39:40.596373 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-464423c9-94e9-4a9e-a918-ebf4f9bae1c8 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515" status: 200 len: 1678 microversion: 2.1 time: 0.157417 Jan 18 16:39:40.596955 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 493/993] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:39:40 2022] GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:39:41.613686 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-062000f5-fdf2-4e8b-b085-951ac4b93e04 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:39:41.616208 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-062000f5-fdf2-4e8b-b085-951ac4b93e04 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:39:41.622458 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-062000f5-fdf2-4e8b-b085-951ac4b93e04 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:39:41.622900 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-062000f5-fdf2-4e8b-b085-951ac4b93e04 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:39:41.623687 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-062000f5-fdf2-4e8b-b085-951ac4b93e04 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:39:41.624113 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-062000f5-fdf2-4e8b-b085-951ac4b93e04 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:39:41.715229 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-935d8d91-9963-4d5e-8a13-219928d6f8d1 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:39:41.715852 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-935d8d91-9963-4d5e-8a13-219928d6f8d1 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: ee1e9d7a-4800-4716-8b74-cc144c0722ce] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:39:41.722198 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-935d8d91-9963-4d5e-8a13-219928d6f8d1 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:39:41.722652 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-935d8d91-9963-4d5e-8a13-219928d6f8d1 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:39:41.723448 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-935d8d91-9963-4d5e-8a13-219928d6f8d1 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:39:41.723883 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-935d8d91-9963-4d5e-8a13-219928d6f8d1 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:39:41.752500 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-935d8d91-9963-4d5e-8a13-219928d6f8d1 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: ee1e9d7a-4800-4716-8b74-cc144c0722ce] Going to try to terminate instance {{(pid=116368) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 18 16:39:41.763360 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-062000f5-fdf2-4e8b-b085-951ac4b93e04 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:39:41.770872 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-062000f5-fdf2-4e8b-b085-951ac4b93e04 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515" status: 200 len: 1678 microversion: 2.1 time: 0.161001 Jan 18 16:39:41.777643 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 501/994] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:39:41 2022] GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:39:41.777643 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [req-ab6d9575-8ec4-4c8b-8274-98d2c8aaaf00 req-06b1435e-44fb-4129-a692-80c09307eef3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee1e9d7a-4800-4716-8b74-cc144c0722ce", "tag": "b307d78d-8690-4dee-b716-4f18e6567bfe"}]} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:39:41.778702 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:39:41.778702 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: warnings.warn(msg) Jan 18 16:39:41.785592 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-ab6d9575-8ec4-4c8b-8274-98d2c8aaaf00 req-06b1435e-44fb-4129-a692-80c09307eef3 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:39:41.786065 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-ab6d9575-8ec4-4c8b-8274-98d2c8aaaf00 req-06b1435e-44fb-4129-a692-80c09307eef3 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:39:41.798315 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.compute.server_external_events [req-ab6d9575-8ec4-4c8b-8274-98d2c8aaaf00 req-06b1435e-44fb-4129-a692-80c09307eef3 service nova] Creating event network-changed:b307d78d-8690-4dee-b716-4f18e6567bfe for instance ee1e9d7a-4800-4716-8b74-cc144c0722ce on hv-cinder-78836 Jan 18 16:39:41.804103 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [req-ab6d9575-8ec4-4c8b-8274-98d2c8aaaf00 req-06b1435e-44fb-4129-a692-80c09307eef3 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030023 Jan 18 16:39:41.805043 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 502/995] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:39:41.838308 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-935d8d91-9963-4d5e-8a13-219928d6f8d1 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "DELETE /compute/v2.1/servers/ee1e9d7a-4800-4716-8b74-cc144c0722ce" status: 204 len: 0 microversion: 2.1 time: 0.126017 Jan 18 16:39:41.841773 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 494/996] 10.222.0.82 () {58 vars in 1238 bytes} [Tue Jan 18 16:39:41 2022] DELETE /compute/v2.1/servers/ee1e9d7a-4800-4716-8b74-cc144c0722ce => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 18 16:39:41.851136 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-4fe56e23-0057-4052-a22d-b0545a56f19b tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:39:41.851398 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-4fe56e23-0057-4052-a22d-b0545a56f19b tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: ee1e9d7a-4800-4716-8b74-cc144c0722ce] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:39:41.857489 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4fe56e23-0057-4052-a22d-b0545a56f19b tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:39:41.857930 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4fe56e23-0057-4052-a22d-b0545a56f19b tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:39:41.858714 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4fe56e23-0057-4052-a22d-b0545a56f19b tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:39:41.859130 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4fe56e23-0057-4052-a22d-b0545a56f19b tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:39:42.114746 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-4fe56e23-0057-4052-a22d-b0545a56f19b tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:39:42.117164 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-4fe56e23-0057-4052-a22d-b0545a56f19b tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/ee1e9d7a-4800-4716-8b74-cc144c0722ce" status: 200 len: 1578 microversion: 2.1 time: 0.273729 Jan 18 16:39:42.118851 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 503/997] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:39:41 2022] GET /compute/v2.1/servers/ee1e9d7a-4800-4716-8b74-cc144c0722ce => generated 1578 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:39:42.789355 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-e5fa136b-29ab-4cca-8c11-1b936447ee48 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:39:42.790062 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-e5fa136b-29ab-4cca-8c11-1b936447ee48 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:39:42.796316 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e5fa136b-29ab-4cca-8c11-1b936447ee48 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:39:42.796764 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e5fa136b-29ab-4cca-8c11-1b936447ee48 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:39:42.797584 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e5fa136b-29ab-4cca-8c11-1b936447ee48 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:39:42.798024 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e5fa136b-29ab-4cca-8c11-1b936447ee48 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:39:42.930620 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-e5fa136b-29ab-4cca-8c11-1b936447ee48 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:39:42.937963 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-e5fa136b-29ab-4cca-8c11-1b936447ee48 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515" status: 200 len: 1678 microversion: 2.1 time: 0.152809 Jan 18 16:39:42.938529 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 495/998] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:39:42 2022] GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:39:43.137528 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-8ad3ed94-0bf9-42c7-b522-73d30fc33391 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:39:43.138119 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-8ad3ed94-0bf9-42c7-b522-73d30fc33391 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: ee1e9d7a-4800-4716-8b74-cc144c0722ce] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:39:43.144423 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-8ad3ed94-0bf9-42c7-b522-73d30fc33391 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:39:43.144869 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-8ad3ed94-0bf9-42c7-b522-73d30fc33391 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:39:43.145668 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-8ad3ed94-0bf9-42c7-b522-73d30fc33391 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:39:43.146101 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-8ad3ed94-0bf9-42c7-b522-73d30fc33391 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:39:43.276866 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-8ad3ed94-0bf9-42c7-b522-73d30fc33391 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:39:43.284150 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-8ad3ed94-0bf9-42c7-b522-73d30fc33391 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/ee1e9d7a-4800-4716-8b74-cc144c0722ce" status: 200 len: 1460 microversion: 2.1 time: 0.150269 Jan 18 16:39:43.284714 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 504/999] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:39:43 2022] GET /compute/v2.1/servers/ee1e9d7a-4800-4716-8b74-cc144c0722ce => generated 1460 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:39:43.840427 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [req-2b2d447e-68dd-4f9d-a79f-d4cfd589847b req-a83b928a-93bf-41cf-b4bb-109b683366ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee1e9d7a-4800-4716-8b74-cc144c0722ce", "name": "network-vif-deleted", "tag": "b307d78d-8690-4dee-b716-4f18e6567bfe"}]} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:39:43.842118 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:39:43.842118 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: warnings.warn(msg) Jan 18 16:39:43.849795 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-2b2d447e-68dd-4f9d-a79f-d4cfd589847b req-a83b928a-93bf-41cf-b4bb-109b683366ed service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:39:43.850494 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-2b2d447e-68dd-4f9d-a79f-d4cfd589847b req-a83b928a-93bf-41cf-b4bb-109b683366ed service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:39:43.861529 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.compute.server_external_events [req-2b2d447e-68dd-4f9d-a79f-d4cfd589847b req-a83b928a-93bf-41cf-b4bb-109b683366ed service nova] Creating event network-vif-deleted:b307d78d-8690-4dee-b716-4f18e6567bfe for instance ee1e9d7a-4800-4716-8b74-cc144c0722ce on hv-cinder-78836 Jan 18 16:39:43.866453 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [req-2b2d447e-68dd-4f9d-a79f-d4cfd589847b req-a83b928a-93bf-41cf-b4bb-109b683366ed service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029671 Jan 18 16:39:43.867045 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 496/1000] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:39:43.955422 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-05469e3f-26fc-4a71-9f2e-8801b4dacfe6 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:39:43.956032 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-05469e3f-26fc-4a71-9f2e-8801b4dacfe6 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:39:43.962813 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-05469e3f-26fc-4a71-9f2e-8801b4dacfe6 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:39:43.963271 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-05469e3f-26fc-4a71-9f2e-8801b4dacfe6 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:39:43.964055 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-05469e3f-26fc-4a71-9f2e-8801b4dacfe6 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:39:43.964518 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-05469e3f-26fc-4a71-9f2e-8801b4dacfe6 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:39:44.096837 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-05469e3f-26fc-4a71-9f2e-8801b4dacfe6 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:39:44.105227 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-05469e3f-26fc-4a71-9f2e-8801b4dacfe6 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515" status: 200 len: 1655 microversion: 2.1 time: 0.153463 Jan 18 16:39:44.105907 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 505/1001] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:39:43 2022] GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515 => generated 1655 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:39:44.123008 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-c7c355e3-b5d6-4ac1-9cb0-4c61e0d63ef6 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:39:44.129492 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c7c355e3-b5d6-4ac1-9cb0-4c61e0d63ef6 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:39:44.130154 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c7c355e3-b5d6-4ac1-9cb0-4c61e0d63ef6 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:39:44.155999 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-c7c355e3-b5d6-4ac1-9cb0-4c61e0d63ef6 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Going to try to start instance {{(pid=116368) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 18 16:39:44.200183 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-c7c355e3-b5d6-4ac1-9cb0-4c61e0d63ef6 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action" status: 202 len: 0 microversion: 2.1 time: 0.081314 Jan 18 16:39:44.200790 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 497/1002] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:39:44 2022] POST /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:39:44.208893 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-dc2e1387-45b1-4f5d-9d8f-190397a0944b tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:39:44.210294 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-dc2e1387-45b1-4f5d-9d8f-190397a0944b tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:39:44.216905 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-dc2e1387-45b1-4f5d-9d8f-190397a0944b tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:39:44.217638 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-dc2e1387-45b1-4f5d-9d8f-190397a0944b tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:39:44.218612 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-dc2e1387-45b1-4f5d-9d8f-190397a0944b tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:39:44.219088 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-dc2e1387-45b1-4f5d-9d8f-190397a0944b tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:39:44.302173 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-30865db1-e6b0-4418-8191-732237eef418 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:39:44.303329 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-30865db1-e6b0-4418-8191-732237eef418 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: ee1e9d7a-4800-4716-8b74-cc144c0722ce] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:39:44.309664 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-30865db1-e6b0-4418-8191-732237eef418 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:39:44.310114 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-30865db1-e6b0-4418-8191-732237eef418 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:39:44.310906 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-30865db1-e6b0-4418-8191-732237eef418 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:39:44.311349 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-30865db1-e6b0-4418-8191-732237eef418 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:39:44.341935 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-30865db1-e6b0-4418-8191-732237eef418 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:39:44.342386 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-30865db1-e6b0-4418-8191-732237eef418 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:39:44.342837 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.objects.instance [None req-30865db1-e6b0-4418-8191-732237eef418 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lazy-loading 'fault' on Instance uuid ee1e9d7a-4800-4716-8b74-cc144c0722ce {{(pid=116368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 18 16:39:44.414610 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-30865db1-e6b0-4418-8191-732237eef418 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:39:44.422536 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-30865db1-e6b0-4418-8191-732237eef418 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/ee1e9d7a-4800-4716-8b74-cc144c0722ce" status: 200 len: 1230 microversion: 2.1 time: 0.124495 Jan 18 16:39:44.423113 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 498/1003] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:39:44 2022] GET /compute/v2.1/servers/ee1e9d7a-4800-4716-8b74-cc144c0722ce => generated 1230 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:39:44.483306 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-dc2e1387-45b1-4f5d-9d8f-190397a0944b tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:39:44.491109 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-dc2e1387-45b1-4f5d-9d8f-190397a0944b tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515" status: 200 len: 1664 microversion: 2.1 time: 0.285923 Jan 18 16:39:44.491793 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 506/1004] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:39:44 2022] GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515 => generated 1664 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:39:45.441368 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-de02d427-6cb3-4a78-8025-f4cdc4bf1c13 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:39:45.441993 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-de02d427-6cb3-4a78-8025-f4cdc4bf1c13 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: ee1e9d7a-4800-4716-8b74-cc144c0722ce] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:39:45.449080 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-de02d427-6cb3-4a78-8025-f4cdc4bf1c13 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:39:45.449535 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-de02d427-6cb3-4a78-8025-f4cdc4bf1c13 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:39:45.450362 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-de02d427-6cb3-4a78-8025-f4cdc4bf1c13 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:39:45.450803 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-de02d427-6cb3-4a78-8025-f4cdc4bf1c13 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:39:45.464631 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.wsgi [None req-de02d427-6cb3-4a78-8025-f4cdc4bf1c13 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] HTTP exception thrown: Instance ee1e9d7a-4800-4716-8b74-cc144c0722ce could not be found. Jan 18 16:39:45.465266 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-de02d427-6cb3-4a78-8025-f4cdc4bf1c13 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Returning 404 to user: Instance ee1e9d7a-4800-4716-8b74-cc144c0722ce could not be found. {{(pid=116368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 16:39:45.466090 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-de02d427-6cb3-4a78-8025-f4cdc4bf1c13 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/ee1e9d7a-4800-4716-8b74-cc144c0722ce" status: 404 len: 111 microversion: 2.1 time: 0.028857 Jan 18 16:39:45.466620 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 499/1005] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:39:45 2022] GET /compute/v2.1/servers/ee1e9d7a-4800-4716-8b74-cc144c0722ce => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 16:39:45.508723 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-de536a96-824d-409c-853f-2170be4adc23 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:39:45.509365 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-de536a96-824d-409c-853f-2170be4adc23 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:39:45.516503 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-de536a96-824d-409c-853f-2170be4adc23 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:39:45.516977 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-de536a96-824d-409c-853f-2170be4adc23 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:39:45.517825 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-de536a96-824d-409c-853f-2170be4adc23 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:39:45.518362 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-de536a96-824d-409c-853f-2170be4adc23 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:39:45.654018 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-de536a96-824d-409c-853f-2170be4adc23 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:39:45.661350 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-de536a96-824d-409c-853f-2170be4adc23 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515" status: 200 len: 1668 microversion: 2.1 time: 0.157486 Jan 18 16:39:45.661968 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 507/1006] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:39:45 2022] GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515 => generated 1668 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:39:48.523572 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-e9d3aa4f-d44f-40b4-ba2f-f9a02cb77f66 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:39:48.524271 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-e9d3aa4f-d44f-40b4-ba2f-f9a02cb77f66 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:39:48.526013 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [req-bd5442f1-6da7-4474-9ed3-c0afda1ea3c3 req-3a1aa067-ce10-42a1-8a8e-f077760af4a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987", "tag": "3db787b2-9f3f-4ce3-98a8-15e5146e27d0"}]} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:39:48.527581 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:39:48.527581 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: warnings.warn(msg) Jan 18 16:39:48.530439 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e9d3aa4f-d44f-40b4-ba2f-f9a02cb77f66 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:39:48.530952 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e9d3aa4f-d44f-40b4-ba2f-f9a02cb77f66 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:39:48.531801 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e9d3aa4f-d44f-40b4-ba2f-f9a02cb77f66 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:39:48.532301 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e9d3aa4f-d44f-40b4-ba2f-f9a02cb77f66 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:39:48.534920 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-bd5442f1-6da7-4474-9ed3-c0afda1ea3c3 req-3a1aa067-ce10-42a1-8a8e-f077760af4a2 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:39:48.535523 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-bd5442f1-6da7-4474-9ed3-c0afda1ea3c3 req-3a1aa067-ce10-42a1-8a8e-f077760af4a2 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:39:48.546371 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.compute.server_external_events [req-bd5442f1-6da7-4474-9ed3-c0afda1ea3c3 req-3a1aa067-ce10-42a1-8a8e-f077760af4a2 service nova] Creating event network-changed:3db787b2-9f3f-4ce3-98a8-15e5146e27d0 for instance a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987 on hv-cinder-78836 Jan 18 16:39:48.551556 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [req-bd5442f1-6da7-4474-9ed3-c0afda1ea3c3 req-3a1aa067-ce10-42a1-8a8e-f077760af4a2 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029208 Jan 18 16:39:48.552968 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 508/1007] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:39:48.559462 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-e9d3aa4f-d44f-40b4-ba2f-f9a02cb77f66 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987] Going to try to terminate instance {{(pid=116368) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 18 16:39:48.641025 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-e9d3aa4f-d44f-40b4-ba2f-f9a02cb77f66 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "DELETE /compute/v2.1/servers/a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987" status: 204 len: 0 microversion: 2.1 time: 0.120895 Jan 18 16:39:48.645494 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 500/1008] 10.222.0.82 () {58 vars in 1238 bytes} [Tue Jan 18 16:39:48 2022] DELETE /compute/v2.1/servers/a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 18 16:39:48.651868 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-1c1f0f2e-f980-4dbb-8349-9e69aae4274c tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:39:48.652756 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-1c1f0f2e-f980-4dbb-8349-9e69aae4274c tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:39:48.661148 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-1c1f0f2e-f980-4dbb-8349-9e69aae4274c tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:39:48.662508 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-1c1f0f2e-f980-4dbb-8349-9e69aae4274c tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:39:48.663548 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-1c1f0f2e-f980-4dbb-8349-9e69aae4274c tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:39:48.664132 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-1c1f0f2e-f980-4dbb-8349-9e69aae4274c tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:39:48.898014 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-1c1f0f2e-f980-4dbb-8349-9e69aae4274c tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:39:48.905684 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-1c1f0f2e-f980-4dbb-8349-9e69aae4274c tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987" status: 200 len: 1578 microversion: 2.1 time: 0.258120 Jan 18 16:39:48.907987 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 509/1009] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:39:48 2022] GET /compute/v2.1/servers/a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987 => generated 1578 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:39:49.923519 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-f030d800-9542-4f42-a187-78140f6d4e5f tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:39:49.924228 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-f030d800-9542-4f42-a187-78140f6d4e5f tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:39:49.930550 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f030d800-9542-4f42-a187-78140f6d4e5f tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:39:49.931001 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f030d800-9542-4f42-a187-78140f6d4e5f tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:39:49.931778 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f030d800-9542-4f42-a187-78140f6d4e5f tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:39:49.932216 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f030d800-9542-4f42-a187-78140f6d4e5f tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:39:50.068528 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-f030d800-9542-4f42-a187-78140f6d4e5f tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:39:50.075828 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-f030d800-9542-4f42-a187-78140f6d4e5f tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987" status: 200 len: 1460 microversion: 2.1 time: 0.156360 Jan 18 16:39:50.076400 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 501/1010] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:39:49 2022] GET /compute/v2.1/servers/a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987 => generated 1460 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:39:50.648131 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [req-ed6a5353-8649-4a4f-8dac-59a210cfb4c1 req-acba30b8-faf2-42cb-ba1e-4e5195b9ae74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987", "name": "network-vif-deleted", "tag": "3db787b2-9f3f-4ce3-98a8-15e5146e27d0"}]} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:39:50.649746 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:39:50.649746 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: warnings.warn(msg) Jan 18 16:39:50.657019 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-ed6a5353-8649-4a4f-8dac-59a210cfb4c1 req-acba30b8-faf2-42cb-ba1e-4e5195b9ae74 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:39:50.657457 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-ed6a5353-8649-4a4f-8dac-59a210cfb4c1 req-acba30b8-faf2-42cb-ba1e-4e5195b9ae74 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:39:50.669377 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.compute.server_external_events [req-ed6a5353-8649-4a4f-8dac-59a210cfb4c1 req-acba30b8-faf2-42cb-ba1e-4e5195b9ae74 service nova] Creating event network-vif-deleted:3db787b2-9f3f-4ce3-98a8-15e5146e27d0 for instance a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987 on hv-cinder-78836 Jan 18 16:39:50.674089 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [req-ed6a5353-8649-4a4f-8dac-59a210cfb4c1 req-acba30b8-faf2-42cb-ba1e-4e5195b9ae74 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029586 Jan 18 16:39:50.674732 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 510/1011] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:39:51.093248 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-b5959bc1-89cf-4c79-a2e6-54f8ffb5b38b tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:39:51.093855 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-b5959bc1-89cf-4c79-a2e6-54f8ffb5b38b tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:39:51.100003 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-b5959bc1-89cf-4c79-a2e6-54f8ffb5b38b tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:39:51.100442 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-b5959bc1-89cf-4c79-a2e6-54f8ffb5b38b tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:39:51.101250 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-b5959bc1-89cf-4c79-a2e6-54f8ffb5b38b tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:39:51.101683 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-b5959bc1-89cf-4c79-a2e6-54f8ffb5b38b tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:39:51.130391 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-b5959bc1-89cf-4c79-a2e6-54f8ffb5b38b tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:39:51.131525 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-b5959bc1-89cf-4c79-a2e6-54f8ffb5b38b tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:39:51.131975 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.objects.instance [None req-b5959bc1-89cf-4c79-a2e6-54f8ffb5b38b tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lazy-loading 'fault' on Instance uuid a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987 {{(pid=116368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 18 16:39:51.170156 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-b5959bc1-89cf-4c79-a2e6-54f8ffb5b38b tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345686887fc3424fa518114e23f7fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9ac86cb4c4f109b49c6f9a66379a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:39:51.178023 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-b5959bc1-89cf-4c79-a2e6-54f8ffb5b38b tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987" status: 200 len: 1230 microversion: 2.1 time: 0.087806 Jan 18 16:39:51.178784 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 502/1012] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:39:51 2022] GET /compute/v2.1/servers/a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987 => generated 1230 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:39:52.196608 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-fff95b1b-13fa-41c1-8e5c-d5f7ed1d4619 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:39:52.197360 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-fff95b1b-13fa-41c1-8e5c-d5f7ed1d4619 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:39:52.203396 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-fff95b1b-13fa-41c1-8e5c-d5f7ed1d4619 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:39:52.203843 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-fff95b1b-13fa-41c1-8e5c-d5f7ed1d4619 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:39:52.204617 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-fff95b1b-13fa-41c1-8e5c-d5f7ed1d4619 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:39:52.205083 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-fff95b1b-13fa-41c1-8e5c-d5f7ed1d4619 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:39:52.218563 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.wsgi [None req-fff95b1b-13fa-41c1-8e5c-d5f7ed1d4619 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] HTTP exception thrown: Instance a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987 could not be found. Jan 18 16:39:52.219142 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-fff95b1b-13fa-41c1-8e5c-d5f7ed1d4619 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Returning 404 to user: Instance a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987 could not be found. {{(pid=116367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 16:39:52.219956 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-fff95b1b-13fa-41c1-8e5c-d5f7ed1d4619 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987" status: 404 len: 111 microversion: 2.1 time: 0.029146 Jan 18 16:39:52.220489 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 511/1013] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:39:52 2022] GET /compute/v2.1/servers/a7e1bcfc-adc4-4b72-8ced-9cc32ee3d987 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 16:39:52.671970 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-975f1d4d-8e77-499b-9e8a-5cc949e4f293 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:39:52.672489 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-975f1d4d-8e77-499b-9e8a-5cc949e4f293 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: 5b927087-6400-4a41-b19e-0e417905395e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:39:52.679493 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-975f1d4d-8e77-499b-9e8a-5cc949e4f293 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:39:52.679938 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-975f1d4d-8e77-499b-9e8a-5cc949e4f293 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:39:52.680710 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-975f1d4d-8e77-499b-9e8a-5cc949e4f293 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:39:52.681172 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-975f1d4d-8e77-499b-9e8a-5cc949e4f293 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:39:52.695319 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.wsgi [None req-975f1d4d-8e77-499b-9e8a-5cc949e4f293 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] HTTP exception thrown: Instance 5b927087-6400-4a41-b19e-0e417905395e could not be found. Jan 18 16:39:52.695980 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-975f1d4d-8e77-499b-9e8a-5cc949e4f293 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Returning 404 to user: Instance 5b927087-6400-4a41-b19e-0e417905395e could not be found. {{(pid=116368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 16:39:52.696803 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-975f1d4d-8e77-499b-9e8a-5cc949e4f293 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "DELETE /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e" status: 404 len: 111 microversion: 2.1 time: 0.028521 Jan 18 16:39:52.697366 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 503/1014] 10.222.0.82 () {58 vars in 1238 bytes} [Tue Jan 18 16:39:52 2022] DELETE /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 16:39:52.705248 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-40939cd5-d65c-4c15-ae24-10fee9ebee89 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:39:52.705882 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-40939cd5-d65c-4c15-ae24-10fee9ebee89 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] [instance: 5b927087-6400-4a41-b19e-0e417905395e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:39:52.711811 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-40939cd5-d65c-4c15-ae24-10fee9ebee89 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:39:52.712250 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-40939cd5-d65c-4c15-ae24-10fee9ebee89 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:39:52.713047 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-40939cd5-d65c-4c15-ae24-10fee9ebee89 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:39:52.713474 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-40939cd5-d65c-4c15-ae24-10fee9ebee89 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:39:52.726820 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.wsgi [None req-40939cd5-d65c-4c15-ae24-10fee9ebee89 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] HTTP exception thrown: Instance 5b927087-6400-4a41-b19e-0e417905395e could not be found. Jan 18 16:39:52.727394 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-40939cd5-d65c-4c15-ae24-10fee9ebee89 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Returning 404 to user: Instance 5b927087-6400-4a41-b19e-0e417905395e could not be found. {{(pid=116367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 16:39:52.728189 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-40939cd5-d65c-4c15-ae24-10fee9ebee89 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e" status: 404 len: 111 microversion: 2.1 time: 0.026600 Jan 18 16:39:52.728707 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 512/1015] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:39:52 2022] GET /compute/v2.1/servers/5b927087-6400-4a41-b19e-0e417905395e => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 16:39:54.011575 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-7894f48f-8382-4311-ad6e-3b873a0ab3e4 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] Calling method '.version_select at 0x7f33a4bb8820>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:39:54.030224 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-7894f48f-8382-4311-ad6e-3b873a0ab3e4 tempest-TestVolumeBootPattern-1915103728 tempest-TestVolumeBootPattern-1915103728-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-528604224" status: 202 len: 0 microversion: 2.1 time: 0.022871 Jan 18 16:39:54.030889 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 504/1016] 10.222.0.82 () {58 vars in 1259 bytes} [Tue Jan 18 16:39:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-528604224 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:39:56.624377 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 18 16:39:56.625036 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: Tue Jan 18 16:39:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 18 16:39:58.811967 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 18 16:39:58.812405 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: Tue Jan 18 16:39:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 18 16:40:12.278130 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 18 16:40:12.278773 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: Tue Jan 18 16:40:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 18 16:40:18.263989 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-d95ee3d2-f6b4-4b50-bb86-da752e23d2eb tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:40:18.264896 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-d95ee3d2-f6b4-4b50-bb86-da752e23d2eb tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:40:18.271553 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-d95ee3d2-f6b4-4b50-bb86-da752e23d2eb tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:18.271995 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-d95ee3d2-f6b4-4b50-bb86-da752e23d2eb tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:18.273374 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-d95ee3d2-f6b4-4b50-bb86-da752e23d2eb tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:18.273816 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-d95ee3d2-f6b4-4b50-bb86-da752e23d2eb tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:18.302218 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-d95ee3d2-f6b4-4b50-bb86-da752e23d2eb tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042118 Jan 18 16:40:18.302759 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 513/1017] 10.222.0.82 () {58 vars in 1301 bytes} [Tue Jan 18 16:40:18 2022] GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 18 16:40:18.359063 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-3d086853-3cb3-45e2-bf55-6f5ae762262f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:40:18.359580 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-3d086853-3cb3-45e2-bf55-6f5ae762262f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:40:18.365289 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3d086853-3cb3-45e2-bf55-6f5ae762262f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:18.365750 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3d086853-3cb3-45e2-bf55-6f5ae762262f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:18.367198 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3d086853-3cb3-45e2-bf55-6f5ae762262f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:18.367742 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3d086853-3cb3-45e2-bf55-6f5ae762262f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:18.391211 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-3d086853-3cb3-45e2-bf55-6f5ae762262f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Going to try to terminate instance {{(pid=116368) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 18 16:40:18.466173 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-3d086853-3cb3-45e2-bf55-6f5ae762262f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "DELETE /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515" status: 204 len: 0 microversion: 2.1 time: 0.111341 Jan 18 16:40:18.466770 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 505/1018] 10.222.0.82 () {58 vars in 1238 bytes} [Tue Jan 18 16:40:18 2022] DELETE /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 18 16:40:18.475305 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-8ff9161e-0804-4f72-9b73-e79c8baa560f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:40:18.476571 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-8ff9161e-0804-4f72-9b73-e79c8baa560f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:40:18.482405 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-8ff9161e-0804-4f72-9b73-e79c8baa560f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:18.482850 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-8ff9161e-0804-4f72-9b73-e79c8baa560f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:18.483622 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-8ff9161e-0804-4f72-9b73-e79c8baa560f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:18.484057 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-8ff9161e-0804-4f72-9b73-e79c8baa560f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:18.815197 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-8ff9161e-0804-4f72-9b73-e79c8baa560f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:40:18.823717 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-8ff9161e-0804-4f72-9b73-e79c8baa560f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515" status: 200 len: 1674 microversion: 2.1 time: 0.352144 Jan 18 16:40:18.824288 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 514/1019] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:40:18 2022] GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515 => generated 1674 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:40:19.841099 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-15497800-c58a-418b-938f-440342eec97a tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:40:19.841823 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-15497800-c58a-418b-938f-440342eec97a tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:40:19.847973 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-15497800-c58a-418b-938f-440342eec97a tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:19.848422 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-15497800-c58a-418b-938f-440342eec97a tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:19.849226 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-15497800-c58a-418b-938f-440342eec97a tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:19.849671 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-15497800-c58a-418b-938f-440342eec97a tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:20.033139 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-15497800-c58a-418b-938f-440342eec97a tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:40:20.040909 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-15497800-c58a-418b-938f-440342eec97a tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515" status: 200 len: 1674 microversion: 2.1 time: 0.203911 Jan 18 16:40:20.041495 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 506/1020] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:40:19 2022] GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515 => generated 1674 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:40:21.058320 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-74e9aeed-c3fd-4290-8212-1ccd537f3396 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:40:21.058920 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-74e9aeed-c3fd-4290-8212-1ccd537f3396 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:40:21.065099 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-74e9aeed-c3fd-4290-8212-1ccd537f3396 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:21.065539 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-74e9aeed-c3fd-4290-8212-1ccd537f3396 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:21.066583 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-74e9aeed-c3fd-4290-8212-1ccd537f3396 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:21.067009 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-74e9aeed-c3fd-4290-8212-1ccd537f3396 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:21.138447 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-74e9aeed-c3fd-4290-8212-1ccd537f3396 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:40:21.145952 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-74e9aeed-c3fd-4290-8212-1ccd537f3396 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515" status: 200 len: 1607 microversion: 2.1 time: 0.091852 Jan 18 16:40:21.146528 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 515/1021] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:40:21 2022] GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515 => generated 1607 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:40:21.307521 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [req-91b3c2d4-9359-43fe-89c7-adf159b8b9f8 req-e5d12cb0-1675-4d62-85d7-3d65c7281022 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c365b3e-1a90-40d6-8269-84bbf61e7515", "name": "network-vif-deleted", "tag": "7a80e69a-7561-4746-bbc6-6bf9690c4752"}]} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:40:21.309196 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:40:21.309196 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: warnings.warn(msg) Jan 18 16:40:21.317583 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-91b3c2d4-9359-43fe-89c7-adf159b8b9f8 req-e5d12cb0-1675-4d62-85d7-3d65c7281022 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:21.318103 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-91b3c2d4-9359-43fe-89c7-adf159b8b9f8 req-e5d12cb0-1675-4d62-85d7-3d65c7281022 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:21.330045 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.compute.server_external_events [req-91b3c2d4-9359-43fe-89c7-adf159b8b9f8 req-e5d12cb0-1675-4d62-85d7-3d65c7281022 service nova] Creating event network-vif-deleted:7a80e69a-7561-4746-bbc6-6bf9690c4752 for instance 7c365b3e-1a90-40d6-8269-84bbf61e7515 on hv-cinder-78836 Jan 18 16:40:21.336211 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [req-91b3c2d4-9359-43fe-89c7-adf159b8b9f8 req-e5d12cb0-1675-4d62-85d7-3d65c7281022 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032714 Jan 18 16:40:21.337259 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 507/1022] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:40:22.162742 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-56b63d8f-9cb9-4460-9104-330deecff66c tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:40:22.164135 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-56b63d8f-9cb9-4460-9104-330deecff66c tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:40:22.170749 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-56b63d8f-9cb9-4460-9104-330deecff66c tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:22.171207 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-56b63d8f-9cb9-4460-9104-330deecff66c tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:22.171998 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-56b63d8f-9cb9-4460-9104-330deecff66c tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:22.172431 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-56b63d8f-9cb9-4460-9104-330deecff66c tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:22.187408 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.wsgi [None req-56b63d8f-9cb9-4460-9104-330deecff66c tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] HTTP exception thrown: Instance 7c365b3e-1a90-40d6-8269-84bbf61e7515 could not be found. Jan 18 16:40:22.188005 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-56b63d8f-9cb9-4460-9104-330deecff66c tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Returning 404 to user: Instance 7c365b3e-1a90-40d6-8269-84bbf61e7515 could not be found. {{(pid=116367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 16:40:22.188829 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-56b63d8f-9cb9-4460-9104-330deecff66c tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515" status: 404 len: 111 microversion: 2.1 time: 0.029782 Jan 18 16:40:22.189414 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 516/1023] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:40:22 2022] GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 16:40:22.199111 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-43a4e91b-f719-45d3-bc67-76c5b1698dbc tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '.version_select at 0x7f33a4b14f70>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:40:22.218086 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-43a4e91b-f719-45d3-bc67-76c5b1698dbc tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2022187801" status: 202 len: 0 microversion: 2.1 time: 0.022702 Jan 18 16:40:22.218778 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 508/1024] 10.222.0.82 () {58 vars in 1220 bytes} [Tue Jan 18 16:40:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2022187801 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 18 16:40:22.869684 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-18dbbaf1-d8b4-48c4-ac2b-3ae19221bb3c tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'create', calling method: .version_select at 0x7f33a550b0d0>, body: {"keypair": {"name": "tempest-keypair-1733782697"}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:40:22.883184 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.quota [None req-18dbbaf1-d8b4-48c4-ac2b-3ae19221bb3c tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Getting quotas for project 7b7c9d7399db4865a899d61aa89b988d. Resources: {'key_pairs'} {{(pid=116367) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 16:40:22.887068 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.quota [None req-18dbbaf1-d8b4-48c4-ac2b-3ae19221bb3c tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Getting quotas for user 08aeeb75184240ce9c0c17fc54e6eb18 and project 7b7c9d7399db4865a899d61aa89b988d. Resources: {'key_pairs'} {{(pid=116367) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 16:40:23.025573 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.quota [None req-18dbbaf1-d8b4-48c4-ac2b-3ae19221bb3c tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Getting quotas for project 7b7c9d7399db4865a899d61aa89b988d. Resources: {'key_pairs'} {{(pid=116367) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 16:40:23.029151 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.quota [None req-18dbbaf1-d8b4-48c4-ac2b-3ae19221bb3c tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Getting quotas for user 08aeeb75184240ce9c0c17fc54e6eb18 and project 7b7c9d7399db4865a899d61aa89b988d. Resources: {'key_pairs'} {{(pid=116367) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 16:40:23.042454 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-18dbbaf1-d8b4-48c4-ac2b-3ae19221bb3c tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.177517 Jan 18 16:40:23.043046 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 517/1025] 10.222.0.82 () {60 vars in 1157 bytes} [Tue Jan 18 16:40:22 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:40:24.318760 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-e578a1af-c897-4742-8666-699747c9007f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1050114802", "imageRef": "900c4a9d-b6c6-451f-a509-eb4f4b49f459", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "631a6541-53f9-4654-914b-6ff69da121f2"}], "security_groups": [{"name": "tempest-securitygroup--1017794259"}], "key_name": "tempest-keypair-1733782697", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:40:24.418710 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.network.neutron [None req-e578a1af-c897-4742-8666-699747c9007f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] validate_networks() for [('631a6541-53f9-4654-914b-6ff69da121f2', None, None, None, None, None)] {{(pid=116368) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 18 16:40:24.789537 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-e578a1af-c897-4742-8666-699747c9007f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Flavor limits 0:0:0 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 18 16:40:24.789995 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-e578a1af-c897-4742-8666-699747c9007f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Image limits 0:0:0 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 18 16:40:24.790471 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-e578a1af-c897-4742-8666-699747c9007f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Flavor pref 0:0:0 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 18 16:40:24.790879 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-e578a1af-c897-4742-8666-699747c9007f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Image pref 0:0:0 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 18 16:40:24.791298 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-e578a1af-c897-4742-8666-699747c9007f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 18 16:40:24.801150 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e578a1af-c897-4742-8666-699747c9007f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:24.801603 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e578a1af-c897-4742-8666-699747c9007f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:24.802460 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e578a1af-c897-4742-8666-699747c9007f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:24.802896 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-e578a1af-c897-4742-8666-699747c9007f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:24.819801 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.quota [None req-e578a1af-c897-4742-8666-699747c9007f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Getting quotas for project 7b7c9d7399db4865a899d61aa89b988d. Resources: {'ram', 'instances', 'cores'} {{(pid=116368) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 16:40:24.823677 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.quota [None req-e578a1af-c897-4742-8666-699747c9007f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Getting quotas for user 08aeeb75184240ce9c0c17fc54e6eb18 and project 7b7c9d7399db4865a899d61aa89b988d. Resources: {'ram', 'instances', 'cores'} {{(pid=116368) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 16:40:24.834137 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-e578a1af-c897-4742-8666-699747c9007f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Going to run 1 instances... {{(pid=116368) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 18 16:40:24.837126 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-e578a1af-c897-4742-8666-699747c9007f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='900c4a9d-b6c6-451f-a509-eb4f4b49f459',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116368) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 18 16:40:24.885111 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-e578a1af-c897-4742-8666-699747c9007f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.570986 Jan 18 16:40:24.885750 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 509/1026] 10.222.0.82 () {60 vars in 1146 bytes} [Tue Jan 18 16:40:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 18 16:40:24.895407 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-3105f1a6-8081-4244-9578-01ca8fe6cd04 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:40:24.896104 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-3105f1a6-8081-4244-9578-01ca8fe6cd04 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:40:24.952940 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-3105f1a6-8081-4244-9578-01ca8fe6cd04 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:40:24.959582 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-3105f1a6-8081-4244-9578-01ca8fe6cd04 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e" status: 200 len: 1238 microversion: 2.1 time: 0.067948 Jan 18 16:40:24.961033 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 518/1027] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:40:24 2022] GET /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e => generated 1238 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:40:25.978319 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-8b30f353-14c5-4c1e-8bed-0bd3f3f6f3e7 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:40:25.979079 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-8b30f353-14c5-4c1e-8bed-0bd3f3f6f3e7 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:40:25.986429 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8b30f353-14c5-4c1e-8bed-0bd3f3f6f3e7 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:25.986429 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8b30f353-14c5-4c1e-8bed-0bd3f3f6f3e7 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:25.987052 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8b30f353-14c5-4c1e-8bed-0bd3f3f6f3e7 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:25.987484 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8b30f353-14c5-4c1e-8bed-0bd3f3f6f3e7 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:26.067634 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-8b30f353-14c5-4c1e-8bed-0bd3f3f6f3e7 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:40:26.075504 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-8b30f353-14c5-4c1e-8bed-0bd3f3f6f3e7 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e" status: 200 len: 1308 microversion: 2.1 time: 0.102183 Jan 18 16:40:26.076083 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 510/1028] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:40:25 2022] GET /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e => generated 1308 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:40:27.092020 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-4d92b7af-3fa3-44b1-9388-8211c7177f67 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:40:27.092681 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-4d92b7af-3fa3-44b1-9388-8211c7177f67 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:40:27.099454 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4d92b7af-3fa3-44b1-9388-8211c7177f67 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:27.099906 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4d92b7af-3fa3-44b1-9388-8211c7177f67 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:27.101246 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4d92b7af-3fa3-44b1-9388-8211c7177f67 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:27.101673 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4d92b7af-3fa3-44b1-9388-8211c7177f67 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:27.304758 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-4d92b7af-3fa3-44b1-9388-8211c7177f67 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:40:27.312748 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-4d92b7af-3fa3-44b1-9388-8211c7177f67 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e" status: 200 len: 1364 microversion: 2.1 time: 0.224626 Jan 18 16:40:27.313683 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 519/1029] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:40:27 2022] GET /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e => generated 1364 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:40:27.375146 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [req-98a440f3-90d5-4f58-acc8-ed71cfde4ea5 req-0fa7036d-610f-4435-9747-446e6f3e419e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10de432b-ed46-41a0-a765-34dd8daf0c4e", "tag": "1130cdbc-16e1-43cb-8f5f-965c89cef3af"}]} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:40:27.377003 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:40:27.377003 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: warnings.warn(msg) Jan 18 16:40:27.388396 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-98a440f3-90d5-4f58-acc8-ed71cfde4ea5 req-0fa7036d-610f-4435-9747-446e6f3e419e service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:27.388396 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-98a440f3-90d5-4f58-acc8-ed71cfde4ea5 req-0fa7036d-610f-4435-9747-446e6f3e419e service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:27.408190 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.compute.server_external_events [req-98a440f3-90d5-4f58-acc8-ed71cfde4ea5 req-0fa7036d-610f-4435-9747-446e6f3e419e service nova] Creating event network-changed:1130cdbc-16e1-43cb-8f5f-965c89cef3af for instance 10de432b-ed46-41a0-a765-34dd8daf0c4e on hv-cinder-78836 Jan 18 16:40:27.414382 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [req-98a440f3-90d5-4f58-acc8-ed71cfde4ea5 req-0fa7036d-610f-4435-9747-446e6f3e419e service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048917 Jan 18 16:40:27.415099 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 511/1030] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:40:28.331238 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-49a4f362-15b3-4191-969f-aca2e4c35ae6 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:40:28.331845 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-49a4f362-15b3-4191-969f-aca2e4c35ae6 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:40:28.338338 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-49a4f362-15b3-4191-969f-aca2e4c35ae6 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:28.338788 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-49a4f362-15b3-4191-969f-aca2e4c35ae6 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:28.339570 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-49a4f362-15b3-4191-969f-aca2e4c35ae6 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:28.340005 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-49a4f362-15b3-4191-969f-aca2e4c35ae6 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:28.478829 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-49a4f362-15b3-4191-969f-aca2e4c35ae6 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:40:28.486289 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-49a4f362-15b3-4191-969f-aca2e4c35ae6 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e" status: 200 len: 1364 microversion: 2.1 time: 0.158727 Jan 18 16:40:28.486849 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 520/1031] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:40:28 2022] GET /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:40:29.504526 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-0df39d8f-3acf-434f-b5aa-fe7fe02c4923 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:40:29.505189 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-0df39d8f-3acf-434f-b5aa-fe7fe02c4923 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:40:29.511371 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0df39d8f-3acf-434f-b5aa-fe7fe02c4923 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:29.511825 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0df39d8f-3acf-434f-b5aa-fe7fe02c4923 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:29.512612 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0df39d8f-3acf-434f-b5aa-fe7fe02c4923 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:29.513080 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0df39d8f-3acf-434f-b5aa-fe7fe02c4923 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:29.642326 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-0df39d8f-3acf-434f-b5aa-fe7fe02c4923 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:40:29.650380 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-0df39d8f-3acf-434f-b5aa-fe7fe02c4923 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e" status: 200 len: 1364 microversion: 2.1 time: 0.150436 Jan 18 16:40:29.650943 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 512/1032] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:40:29 2022] GET /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:40:30.666541 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-91a6458c-b835-47b7-b192-747e4bbc7afb tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:40:30.667068 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-91a6458c-b835-47b7-b192-747e4bbc7afb tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:40:30.673543 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-91a6458c-b835-47b7-b192-747e4bbc7afb tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:30.673985 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-91a6458c-b835-47b7-b192-747e4bbc7afb tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:30.674760 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-91a6458c-b835-47b7-b192-747e4bbc7afb tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:30.675194 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-91a6458c-b835-47b7-b192-747e4bbc7afb tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:30.806284 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-91a6458c-b835-47b7-b192-747e4bbc7afb tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:40:30.813534 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-91a6458c-b835-47b7-b192-747e4bbc7afb tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e" status: 200 len: 1364 microversion: 2.1 time: 0.151145 Jan 18 16:40:30.814107 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 521/1033] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:40:30 2022] GET /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:40:31.831065 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-1c6767b5-9d64-4e43-8470-d4e0da1f98fb tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:40:31.831681 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-1c6767b5-9d64-4e43-8470-d4e0da1f98fb tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:40:31.838676 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1c6767b5-9d64-4e43-8470-d4e0da1f98fb tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:31.839128 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1c6767b5-9d64-4e43-8470-d4e0da1f98fb tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:31.839912 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1c6767b5-9d64-4e43-8470-d4e0da1f98fb tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:31.840351 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1c6767b5-9d64-4e43-8470-d4e0da1f98fb tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:31.971956 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-1c6767b5-9d64-4e43-8470-d4e0da1f98fb tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:40:31.979300 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-1c6767b5-9d64-4e43-8470-d4e0da1f98fb tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e" status: 200 len: 1364 microversion: 2.1 time: 0.151915 Jan 18 16:40:31.979866 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 513/1034] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:40:31 2022] GET /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:40:32.855277 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [req-48dd0906-e30f-4353-ada2-4e08933147bb req-e1340cea-4ca6-42c8-9ff8-08a6b1f24346 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10de432b-ed46-41a0-a765-34dd8daf0c4e", "name": "network-vif-plugged", "status": "completed", "tag": "1130cdbc-16e1-43cb-8f5f-965c89cef3af"}]} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:40:32.856888 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:40:32.856888 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: warnings.warn(msg) Jan 18 16:40:32.863983 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-48dd0906-e30f-4353-ada2-4e08933147bb req-e1340cea-4ca6-42c8-9ff8-08a6b1f24346 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:32.864427 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-48dd0906-e30f-4353-ada2-4e08933147bb req-e1340cea-4ca6-42c8-9ff8-08a6b1f24346 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:32.875474 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.compute.server_external_events [req-48dd0906-e30f-4353-ada2-4e08933147bb req-e1340cea-4ca6-42c8-9ff8-08a6b1f24346 service nova] Creating event network-vif-plugged:1130cdbc-16e1-43cb-8f5f-965c89cef3af for instance 10de432b-ed46-41a0-a765-34dd8daf0c4e on hv-cinder-78836 Jan 18 16:40:32.880421 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [req-48dd0906-e30f-4353-ada2-4e08933147bb req-e1340cea-4ca6-42c8-9ff8-08a6b1f24346 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030052 Jan 18 16:40:32.881444 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 522/1035] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:40:32.996704 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-7e92b1d6-99b8-4e1b-bacc-1d027cf3371f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:40:32.997275 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-7e92b1d6-99b8-4e1b-bacc-1d027cf3371f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:40:33.003479 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7e92b1d6-99b8-4e1b-bacc-1d027cf3371f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:33.003928 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7e92b1d6-99b8-4e1b-bacc-1d027cf3371f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:33.004703 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7e92b1d6-99b8-4e1b-bacc-1d027cf3371f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:33.005172 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7e92b1d6-99b8-4e1b-bacc-1d027cf3371f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:33.176063 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-7e92b1d6-99b8-4e1b-bacc-1d027cf3371f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:40:33.183413 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-7e92b1d6-99b8-4e1b-bacc-1d027cf3371f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e" status: 200 len: 1364 microversion: 2.1 time: 0.191698 Jan 18 16:40:33.183981 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 514/1036] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:40:32 2022] GET /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e => generated 1364 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:40:34.201974 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-c2278366-3ce8-4c76-a695-cc25c93fae67 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:40:34.202698 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-c2278366-3ce8-4c76-a695-cc25c93fae67 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:40:34.208635 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c2278366-3ce8-4c76-a695-cc25c93fae67 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:34.209125 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c2278366-3ce8-4c76-a695-cc25c93fae67 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:34.210412 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c2278366-3ce8-4c76-a695-cc25c93fae67 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:34.210848 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c2278366-3ce8-4c76-a695-cc25c93fae67 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:34.339928 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-c2278366-3ce8-4c76-a695-cc25c93fae67 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:40:34.347170 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-c2278366-3ce8-4c76-a695-cc25c93fae67 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e" status: 200 len: 1550 microversion: 2.1 time: 0.150483 Jan 18 16:40:34.347747 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 523/1037] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:40:34 2022] GET /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e => generated 1550 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:40:34.363957 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-cf39b0fa-2015-4e35-bf5a-5c3908fba030 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:40:34.364465 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-cf39b0fa-2015-4e35-bf5a-5c3908fba030 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:40:34.370795 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-cf39b0fa-2015-4e35-bf5a-5c3908fba030 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:34.371247 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-cf39b0fa-2015-4e35-bf5a-5c3908fba030 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:34.372029 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-cf39b0fa-2015-4e35-bf5a-5c3908fba030 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:34.372884 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-cf39b0fa-2015-4e35-bf5a-5c3908fba030 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:34.451596 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-cf39b0fa-2015-4e35-bf5a-5c3908fba030 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091225 Jan 18 16:40:34.452262 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 515/1038] 10.222.0.82 () {58 vars in 1274 bytes} [Tue Jan 18 16:40:34 2022] GET /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:40:35.622752 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [req-81c8a54b-2ce4-42cd-a265-302675de3808 req-d25febff-95ee-4812-b3b5-336d84954217 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10de432b-ed46-41a0-a765-34dd8daf0c4e", "tag": "1130cdbc-16e1-43cb-8f5f-965c89cef3af"}]} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:40:35.624320 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:40:35.624320 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: warnings.warn(msg) Jan 18 16:40:35.625131 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-3dbb6e0b-097b-4cc2-a5b4-1b606adac285 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:40:35.626068 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-3dbb6e0b-097b-4cc2-a5b4-1b606adac285 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:40:35.632292 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-81c8a54b-2ce4-42cd-a265-302675de3808 req-d25febff-95ee-4812-b3b5-336d84954217 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:35.632978 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-81c8a54b-2ce4-42cd-a265-302675de3808 req-d25febff-95ee-4812-b3b5-336d84954217 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:35.633511 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-3dbb6e0b-097b-4cc2-a5b4-1b606adac285 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:35.633967 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-3dbb6e0b-097b-4cc2-a5b4-1b606adac285 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:35.634760 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-3dbb6e0b-097b-4cc2-a5b4-1b606adac285 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:35.635191 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-3dbb6e0b-097b-4cc2-a5b4-1b606adac285 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:35.644453 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.compute.server_external_events [req-81c8a54b-2ce4-42cd-a265-302675de3808 req-d25febff-95ee-4812-b3b5-336d84954217 service nova] Creating event network-changed:1130cdbc-16e1-43cb-8f5f-965c89cef3af for instance 10de432b-ed46-41a0-a765-34dd8daf0c4e on hv-cinder-78836 Jan 18 16:40:35.652248 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [req-81c8a54b-2ce4-42cd-a265-302675de3808 req-d25febff-95ee-4812-b3b5-336d84954217 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033431 Jan 18 16:40:35.653248 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 516/1039] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:40:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 16:40:35.698927 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-3dbb6e0b-097b-4cc2-a5b4-1b606adac285 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action" status: 200 len: 14 microversion: 2.1 time: 0.083193 Jan 18 16:40:35.700054 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 524/1040] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:40:35 2022] POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 18 16:40:36.711138 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-dd020859-8457-4e9c-9e95-3de1af31e39d tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:40:36.712107 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-dd020859-8457-4e9c-9e95-3de1af31e39d tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:40:36.718130 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-dd020859-8457-4e9c-9e95-3de1af31e39d tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:36.718569 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-dd020859-8457-4e9c-9e95-3de1af31e39d tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:36.719330 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-dd020859-8457-4e9c-9e95-3de1af31e39d tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:36.719755 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-dd020859-8457-4e9c-9e95-3de1af31e39d tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:36.781796 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-dd020859-8457-4e9c-9e95-3de1af31e39d tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action" status: 200 len: 14 microversion: 2.1 time: 0.075075 Jan 18 16:40:36.782367 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 517/1041] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:40:36 2022] POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 18 16:40:37.793253 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-8f224cd2-028a-4497-9ad9-ed889795ac6b tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:40:37.794174 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-8f224cd2-028a-4497-9ad9-ed889795ac6b tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:40:37.801108 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-8f224cd2-028a-4497-9ad9-ed889795ac6b tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:37.801560 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-8f224cd2-028a-4497-9ad9-ed889795ac6b tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:37.802341 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-8f224cd2-028a-4497-9ad9-ed889795ac6b tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:37.802780 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-8f224cd2-028a-4497-9ad9-ed889795ac6b tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:37.859838 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-8f224cd2-028a-4497-9ad9-ed889795ac6b tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action" status: 200 len: 14 microversion: 2.1 time: 0.070494 Jan 18 16:40:37.860451 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 525/1042] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:40:37 2022] POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 18 16:40:38.870408 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-045d8157-ebb0-4223-a6dc-8c991b86d5f3 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:40:38.871317 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-045d8157-ebb0-4223-a6dc-8c991b86d5f3 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:40:38.878156 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-045d8157-ebb0-4223-a6dc-8c991b86d5f3 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:38.878607 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-045d8157-ebb0-4223-a6dc-8c991b86d5f3 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:38.879388 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-045d8157-ebb0-4223-a6dc-8c991b86d5f3 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:38.879825 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-045d8157-ebb0-4223-a6dc-8c991b86d5f3 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:38.941650 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-045d8157-ebb0-4223-a6dc-8c991b86d5f3 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action" status: 200 len: 14 microversion: 2.1 time: 0.074956 Jan 18 16:40:38.942257 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 518/1043] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:40:38 2022] POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 18 16:40:39.953468 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-c755e5d4-a45a-47c0-8b45-568462dbb4fc tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:40:39.954457 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-c755e5d4-a45a-47c0-8b45-568462dbb4fc tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:40:39.962127 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c755e5d4-a45a-47c0-8b45-568462dbb4fc tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:39.962613 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c755e5d4-a45a-47c0-8b45-568462dbb4fc tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:39.963386 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c755e5d4-a45a-47c0-8b45-568462dbb4fc tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:39.963824 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c755e5d4-a45a-47c0-8b45-568462dbb4fc tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:40.032602 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-c755e5d4-a45a-47c0-8b45-568462dbb4fc tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action" status: 200 len: 14 microversion: 2.1 time: 0.083098 Jan 18 16:40:40.033236 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 526/1044] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:40:39 2022] POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 18 16:40:41.044733 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-abf3f5b9-fa3f-4cc3-b18c-ea9ed128bfc1 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:40:41.045857 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-abf3f5b9-fa3f-4cc3-b18c-ea9ed128bfc1 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:40:41.052871 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-abf3f5b9-fa3f-4cc3-b18c-ea9ed128bfc1 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:41.053497 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-abf3f5b9-fa3f-4cc3-b18c-ea9ed128bfc1 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:41.054286 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-abf3f5b9-fa3f-4cc3-b18c-ea9ed128bfc1 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:41.054725 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-abf3f5b9-fa3f-4cc3-b18c-ea9ed128bfc1 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:41.110531 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-abf3f5b9-fa3f-4cc3-b18c-ea9ed128bfc1 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action" status: 200 len: 14 microversion: 2.1 time: 0.069709 Jan 18 16:40:41.111153 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 519/1045] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:40:41 2022] POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 18 16:40:42.122352 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-577f6479-41f2-46ac-90fe-1c61e44a03a3 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:40:42.123333 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-577f6479-41f2-46ac-90fe-1c61e44a03a3 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:40:42.130226 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-577f6479-41f2-46ac-90fe-1c61e44a03a3 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:42.130671 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-577f6479-41f2-46ac-90fe-1c61e44a03a3 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:42.131611 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-577f6479-41f2-46ac-90fe-1c61e44a03a3 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:42.132172 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-577f6479-41f2-46ac-90fe-1c61e44a03a3 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:42.186770 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-577f6479-41f2-46ac-90fe-1c61e44a03a3 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action" status: 200 len: 14 microversion: 2.1 time: 0.068265 Jan 18 16:40:42.187407 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 527/1046] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:40:42 2022] POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action => generated 14 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 18 16:40:43.198685 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-0a76a16d-587f-4952-ab2a-69fe607e87b8 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:40:43.199674 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-0a76a16d-587f-4952-ab2a-69fe607e87b8 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:40:43.208417 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0a76a16d-587f-4952-ab2a-69fe607e87b8 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:43.208872 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0a76a16d-587f-4952-ab2a-69fe607e87b8 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:43.210348 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0a76a16d-587f-4952-ab2a-69fe607e87b8 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:43.210791 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-0a76a16d-587f-4952-ab2a-69fe607e87b8 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:43.271162 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-0a76a16d-587f-4952-ab2a-69fe607e87b8 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action" status: 200 len: 14 microversion: 2.1 time: 0.076590 Jan 18 16:40:43.272317 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 520/1047] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:40:43 2022] POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 18 16:40:44.283393 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-86585cfe-77be-47bc-bac9-6e66354f2807 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:40:44.284378 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-86585cfe-77be-47bc-bac9-6e66354f2807 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:40:44.292293 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-86585cfe-77be-47bc-bac9-6e66354f2807 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:44.292743 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-86585cfe-77be-47bc-bac9-6e66354f2807 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:44.293572 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-86585cfe-77be-47bc-bac9-6e66354f2807 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:44.294008 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-86585cfe-77be-47bc-bac9-6e66354f2807 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:44.352177 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-86585cfe-77be-47bc-bac9-6e66354f2807 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action" status: 200 len: 14 microversion: 2.1 time: 0.072641 Jan 18 16:40:44.353046 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 528/1048] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:40:44 2022] POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 18 16:40:45.363548 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-17a1f801-4cff-4a1d-91ed-4b856d1ab058 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:40:45.364572 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-17a1f801-4cff-4a1d-91ed-4b856d1ab058 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:40:45.371475 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-17a1f801-4cff-4a1d-91ed-4b856d1ab058 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:45.371925 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-17a1f801-4cff-4a1d-91ed-4b856d1ab058 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:45.372706 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-17a1f801-4cff-4a1d-91ed-4b856d1ab058 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:45.373180 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-17a1f801-4cff-4a1d-91ed-4b856d1ab058 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:45.435147 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-17a1f801-4cff-4a1d-91ed-4b856d1ab058 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action" status: 200 len: 14 microversion: 2.1 time: 0.075483 Jan 18 16:40:45.435782 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 521/1049] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:40:45 2022] POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 18 16:40:46.446144 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-76f7fe0c-09af-4a37-82f6-0c16ea5bda9c tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:40:46.447146 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-76f7fe0c-09af-4a37-82f6-0c16ea5bda9c tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:40:46.453979 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-76f7fe0c-09af-4a37-82f6-0c16ea5bda9c tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:46.454430 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-76f7fe0c-09af-4a37-82f6-0c16ea5bda9c tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:46.455218 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-76f7fe0c-09af-4a37-82f6-0c16ea5bda9c tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:46.455657 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-76f7fe0c-09af-4a37-82f6-0c16ea5bda9c tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:46.534066 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-76f7fe0c-09af-4a37-82f6-0c16ea5bda9c tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action" status: 200 len: 9137 microversion: 2.1 time: 0.091983 Jan 18 16:40:46.534612 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 529/1050] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:40:46 2022] POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action => generated 9137 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:40:47.546590 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-c9dcad03-439a-46ac-ade3-ef6f230e214e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:40:47.547514 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-c9dcad03-439a-46ac-ade3-ef6f230e214e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:40:47.554358 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c9dcad03-439a-46ac-ade3-ef6f230e214e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:47.554811 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c9dcad03-439a-46ac-ade3-ef6f230e214e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:47.555595 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c9dcad03-439a-46ac-ade3-ef6f230e214e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:47.556033 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c9dcad03-439a-46ac-ade3-ef6f230e214e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:47.627790 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-c9dcad03-439a-46ac-ade3-ef6f230e214e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action" status: 200 len: 16782 microversion: 2.1 time: 0.085157 Jan 18 16:40:47.628424 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 522/1051] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:40:47 2022] POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action => generated 16782 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:40:48.640842 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-35c43dd9-75ef-482d-85d3-f7c204a17431 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:40:48.641771 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-35c43dd9-75ef-482d-85d3-f7c204a17431 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:40:48.649490 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-35c43dd9-75ef-482d-85d3-f7c204a17431 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:48.649939 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-35c43dd9-75ef-482d-85d3-f7c204a17431 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:48.650721 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-35c43dd9-75ef-482d-85d3-f7c204a17431 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:48.651159 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-35c43dd9-75ef-482d-85d3-f7c204a17431 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:48.723079 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-35c43dd9-75ef-482d-85d3-f7c204a17431 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action" status: 200 len: 18498 microversion: 2.1 time: 0.086249 Jan 18 16:40:48.723705 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 530/1052] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:40:48 2022] POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action => generated 18498 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:40:49.735689 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-7f34cfea-f920-4c8c-94e5-d5111b5e8ec2 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:40:49.736677 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-7f34cfea-f920-4c8c-94e5-d5111b5e8ec2 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:40:49.744208 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7f34cfea-f920-4c8c-94e5-d5111b5e8ec2 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:49.744661 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7f34cfea-f920-4c8c-94e5-d5111b5e8ec2 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:49.745473 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7f34cfea-f920-4c8c-94e5-d5111b5e8ec2 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:49.745911 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-7f34cfea-f920-4c8c-94e5-d5111b5e8ec2 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:49.816187 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-7f34cfea-f920-4c8c-94e5-d5111b5e8ec2 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action" status: 200 len: 20997 microversion: 2.1 time: 0.084078 Jan 18 16:40:49.817100 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 523/1053] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:40:49 2022] POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action => generated 20997 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:40:50.828569 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-10ad7cdb-7e9e-4318-8200-7e150108816c tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:40:50.829592 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-10ad7cdb-7e9e-4318-8200-7e150108816c tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:40:50.836332 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-10ad7cdb-7e9e-4318-8200-7e150108816c tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:50.836774 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-10ad7cdb-7e9e-4318-8200-7e150108816c tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:50.837570 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-10ad7cdb-7e9e-4318-8200-7e150108816c tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:50.837997 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-10ad7cdb-7e9e-4318-8200-7e150108816c tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:50.907637 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-10ad7cdb-7e9e-4318-8200-7e150108816c tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action" status: 200 len: 22988 microversion: 2.1 time: 0.082955 Jan 18 16:40:50.908284 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 531/1054] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:40:50 2022] POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action => generated 22988 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:40:51.919778 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-1d582ed0-fd95-410a-ab6c-960c2b628d1e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:40:51.920770 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-1d582ed0-fd95-410a-ab6c-960c2b628d1e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:40:51.927610 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1d582ed0-fd95-410a-ab6c-960c2b628d1e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:51.928632 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1d582ed0-fd95-410a-ab6c-960c2b628d1e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:51.929449 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1d582ed0-fd95-410a-ab6c-960c2b628d1e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:51.929889 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1d582ed0-fd95-410a-ab6c-960c2b628d1e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:52.003275 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-1d582ed0-fd95-410a-ab6c-960c2b628d1e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action" status: 200 len: 24264 microversion: 2.1 time: 0.087332 Jan 18 16:40:52.003917 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 524/1055] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:40:51 2022] POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action => generated 24264 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:40:53.014714 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-a7aeac8c-f5d1-4948-abcd-8ad101fb7f45 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:40:53.015707 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-a7aeac8c-f5d1-4948-abcd-8ad101fb7f45 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:40:53.023321 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a7aeac8c-f5d1-4948-abcd-8ad101fb7f45 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:53.023768 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a7aeac8c-f5d1-4948-abcd-8ad101fb7f45 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:53.024560 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a7aeac8c-f5d1-4948-abcd-8ad101fb7f45 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:53.025019 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a7aeac8c-f5d1-4948-abcd-8ad101fb7f45 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:53.096527 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-a7aeac8c-f5d1-4948-abcd-8ad101fb7f45 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action" status: 200 len: 25939 microversion: 2.1 time: 0.085825 Jan 18 16:40:53.097184 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 532/1056] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:40:53 2022] POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action => generated 25939 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:40:54.108606 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-eed6caaa-86a4-4c7f-a7ff-88ba33f4382c tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:40:54.109622 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-eed6caaa-86a4-4c7f-a7ff-88ba33f4382c tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:40:54.116356 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-eed6caaa-86a4-4c7f-a7ff-88ba33f4382c tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:54.116797 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-eed6caaa-86a4-4c7f-a7ff-88ba33f4382c tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:54.117594 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-eed6caaa-86a4-4c7f-a7ff-88ba33f4382c tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:54.118023 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-eed6caaa-86a4-4c7f-a7ff-88ba33f4382c tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:54.192304 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-eed6caaa-86a4-4c7f-a7ff-88ba33f4382c tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action" status: 200 len: 27160 microversion: 2.1 time: 0.087566 Jan 18 16:40:54.192992 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 525/1057] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:40:54 2022] POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action => generated 27160 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:40:55.205148 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-1aef3391-253e-4046-819b-d1b2224576db tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:40:55.206246 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-1aef3391-253e-4046-819b-d1b2224576db tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:40:55.213042 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-1aef3391-253e-4046-819b-d1b2224576db tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:55.213491 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-1aef3391-253e-4046-819b-d1b2224576db tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:55.214265 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-1aef3391-253e-4046-819b-d1b2224576db tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:55.214699 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-1aef3391-253e-4046-819b-d1b2224576db tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:55.289304 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-1aef3391-253e-4046-819b-d1b2224576db tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action" status: 200 len: 27914 microversion: 2.1 time: 0.088066 Jan 18 16:40:55.289991 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 533/1058] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:40:55 2022] POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action => generated 27914 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:40:56.301491 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-d28d0a47-9ece-411e-a113-6da09db47653 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:40:56.302990 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-d28d0a47-9ece-411e-a113-6da09db47653 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:40:56.309761 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d28d0a47-9ece-411e-a113-6da09db47653 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:56.310204 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d28d0a47-9ece-411e-a113-6da09db47653 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:56.310974 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d28d0a47-9ece-411e-a113-6da09db47653 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:56.311401 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d28d0a47-9ece-411e-a113-6da09db47653 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:56.385022 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-d28d0a47-9ece-411e-a113-6da09db47653 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action" status: 200 len: 28175 microversion: 2.1 time: 0.087439 Jan 18 16:40:56.385640 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 526/1059] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:40:56 2022] POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action => generated 28175 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:40:57.397776 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-68f244c3-1b56-4537-abba-6ef853a7ee67 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:40:57.398766 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-68f244c3-1b56-4537-abba-6ef853a7ee67 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:40:57.405498 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-68f244c3-1b56-4537-abba-6ef853a7ee67 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:57.405941 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-68f244c3-1b56-4537-abba-6ef853a7ee67 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:57.406708 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-68f244c3-1b56-4537-abba-6ef853a7ee67 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:57.407136 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-68f244c3-1b56-4537-abba-6ef853a7ee67 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:57.466828 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-68f244c3-1b56-4537-abba-6ef853a7ee67 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action" status: 200 len: 28175 microversion: 2.1 time: 0.073811 Jan 18 16:40:57.467449 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 534/1060] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:40:57 2022] POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action => generated 28175 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:40:58.479615 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-ec3515f6-ddf9-4061-945d-f71564845513 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:40:58.480596 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-ec3515f6-ddf9-4061-945d-f71564845513 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:40:58.487477 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ec3515f6-ddf9-4061-945d-f71564845513 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:58.487858 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ec3515f6-ddf9-4061-945d-f71564845513 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:58.488636 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ec3515f6-ddf9-4061-945d-f71564845513 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:58.489139 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-ec3515f6-ddf9-4061-945d-f71564845513 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:58.559422 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-ec3515f6-ddf9-4061-945d-f71564845513 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action" status: 200 len: 28466 microversion: 2.1 time: 0.084347 Jan 18 16:40:58.560432 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 527/1061] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:40:58 2022] POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action => generated 28466 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:40:59.571803 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-99ecbca7-e101-4c99-a6e1-e17579febf1e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:40:59.572744 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-99ecbca7-e101-4c99-a6e1-e17579febf1e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:40:59.579603 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-99ecbca7-e101-4c99-a6e1-e17579febf1e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:59.580054 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-99ecbca7-e101-4c99-a6e1-e17579febf1e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:59.580831 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-99ecbca7-e101-4c99-a6e1-e17579febf1e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:40:59.581319 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-99ecbca7-e101-4c99-a6e1-e17579febf1e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:40:59.655903 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-99ecbca7-e101-4c99-a6e1-e17579febf1e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action" status: 200 len: 28634 microversion: 2.1 time: 0.088212 Jan 18 16:40:59.656794 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 535/1062] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:40:59 2022] POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action => generated 28634 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 18 16:41:00.668563 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-c578509a-eb8c-4236-b383-c372e288d7d9 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:41:00.669564 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-c578509a-eb8c-4236-b383-c372e288d7d9 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:41:00.676744 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c578509a-eb8c-4236-b383-c372e288d7d9 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:00.677280 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c578509a-eb8c-4236-b383-c372e288d7d9 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:00.678763 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c578509a-eb8c-4236-b383-c372e288d7d9 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:00.679245 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c578509a-eb8c-4236-b383-c372e288d7d9 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:00.742970 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-c578509a-eb8c-4236-b383-c372e288d7d9 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action" status: 200 len: 28634 microversion: 2.1 time: 0.078932 Jan 18 16:41:00.743667 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 528/1063] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:41:00 2022] POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action => generated 28634 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:41:01.755257 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-dbb0f33a-dc9b-4e3d-a2bb-771227457a19 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:41:01.756850 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-dbb0f33a-dc9b-4e3d-a2bb-771227457a19 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:41:01.763692 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-dbb0f33a-dc9b-4e3d-a2bb-771227457a19 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:01.764131 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-dbb0f33a-dc9b-4e3d-a2bb-771227457a19 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:01.764903 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-dbb0f33a-dc9b-4e3d-a2bb-771227457a19 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:01.765358 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-dbb0f33a-dc9b-4e3d-a2bb-771227457a19 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:01.824594 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-dbb0f33a-dc9b-4e3d-a2bb-771227457a19 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action" status: 200 len: 28634 microversion: 2.1 time: 0.073117 Jan 18 16:41:01.825292 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 536/1064] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:41:01 2022] POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action => generated 28634 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:41:02.837319 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-6d8107a3-aa4c-44b7-9fb8-54b09ab8bb98 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:41:02.838305 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-6d8107a3-aa4c-44b7-9fb8-54b09ab8bb98 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:41:02.845142 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-6d8107a3-aa4c-44b7-9fb8-54b09ab8bb98 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:02.845598 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-6d8107a3-aa4c-44b7-9fb8-54b09ab8bb98 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:02.846380 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-6d8107a3-aa4c-44b7-9fb8-54b09ab8bb98 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:02.846821 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-6d8107a3-aa4c-44b7-9fb8-54b09ab8bb98 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:02.918787 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-6d8107a3-aa4c-44b7-9fb8-54b09ab8bb98 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action" status: 200 len: 29364 microversion: 2.1 time: 0.085994 Jan 18 16:41:02.919415 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 529/1065] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:41:02 2022] POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action => generated 29364 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:41:03.931587 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-1803cf84-04e7-4b06-8ae3-b54f89c2e38a tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:41:03.932582 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-1803cf84-04e7-4b06-8ae3-b54f89c2e38a tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:41:03.939496 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-1803cf84-04e7-4b06-8ae3-b54f89c2e38a tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:03.939949 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-1803cf84-04e7-4b06-8ae3-b54f89c2e38a tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:03.941046 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-1803cf84-04e7-4b06-8ae3-b54f89c2e38a tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:03.941485 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-1803cf84-04e7-4b06-8ae3-b54f89c2e38a tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:04.038023 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-1803cf84-04e7-4b06-8ae3-b54f89c2e38a tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action" status: 200 len: 31451 microversion: 2.1 time: 0.109735 Jan 18 16:41:04.038947 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 537/1066] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:41:03 2022] POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action => generated 31451 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:41:05.050455 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-533b716a-5efd-4bed-8804-c79799758175 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:41:05.051477 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-533b716a-5efd-4bed-8804-c79799758175 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:41:05.058763 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-533b716a-5efd-4bed-8804-c79799758175 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:05.059206 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-533b716a-5efd-4bed-8804-c79799758175 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:05.059975 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-533b716a-5efd-4bed-8804-c79799758175 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:05.060401 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-533b716a-5efd-4bed-8804-c79799758175 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:05.135920 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-533b716a-5efd-4bed-8804-c79799758175 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action" status: 200 len: 33123 microversion: 2.1 time: 0.089473 Jan 18 16:41:05.136957 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 530/1067] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:41:05 2022] POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action => generated 33123 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:41:06.148897 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-d4c09dc2-99bd-4a38-b854-33b00360014c tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:41:06.149902 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-d4c09dc2-99bd-4a38-b854-33b00360014c tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:41:06.156675 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-d4c09dc2-99bd-4a38-b854-33b00360014c tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:06.157154 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-d4c09dc2-99bd-4a38-b854-33b00360014c tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:06.157921 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-d4c09dc2-99bd-4a38-b854-33b00360014c tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:06.158349 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-d4c09dc2-99bd-4a38-b854-33b00360014c tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:06.230420 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-d4c09dc2-99bd-4a38-b854-33b00360014c tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action" status: 200 len: 34102 microversion: 2.1 time: 0.086122 Jan 18 16:41:06.231058 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 538/1068] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:41:06 2022] POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action => generated 34102 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:41:07.243178 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-b5939a11-95dc-4c74-a759-afd6092f300e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:41:07.244185 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-b5939a11-95dc-4c74-a759-afd6092f300e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:41:07.251003 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-b5939a11-95dc-4c74-a759-afd6092f300e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:07.251443 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-b5939a11-95dc-4c74-a759-afd6092f300e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:07.252214 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-b5939a11-95dc-4c74-a759-afd6092f300e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:07.252673 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-b5939a11-95dc-4c74-a759-afd6092f300e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:07.320811 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-b5939a11-95dc-4c74-a759-afd6092f300e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action" status: 200 len: 35263 microversion: 2.1 time: 0.082057 Jan 18 16:41:07.321492 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 531/1069] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:41:07 2022] POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action => generated 35263 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:41:08.333758 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-5f088fd2-dc5a-44f3-9858-500fbf7c1d16 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:41:08.334714 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-5f088fd2-dc5a-44f3-9858-500fbf7c1d16 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:41:08.341799 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-5f088fd2-dc5a-44f3-9858-500fbf7c1d16 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:08.342250 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-5f088fd2-dc5a-44f3-9858-500fbf7c1d16 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:08.343024 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-5f088fd2-dc5a-44f3-9858-500fbf7c1d16 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:08.343455 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-5f088fd2-dc5a-44f3-9858-500fbf7c1d16 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:08.417862 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-5f088fd2-dc5a-44f3-9858-500fbf7c1d16 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action" status: 200 len: 36703 microversion: 2.1 time: 0.088129 Jan 18 16:41:08.418523 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 539/1070] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:41:08 2022] POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action => generated 36703 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:41:09.430762 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-fdaeec23-a9dc-4c8a-bb33-311a61c70932 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:41:09.431744 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-fdaeec23-a9dc-4c8a-bb33-311a61c70932 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:41:09.438491 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-fdaeec23-a9dc-4c8a-bb33-311a61c70932 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:09.438935 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-fdaeec23-a9dc-4c8a-bb33-311a61c70932 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:09.439701 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-fdaeec23-a9dc-4c8a-bb33-311a61c70932 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:09.440130 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-fdaeec23-a9dc-4c8a-bb33-311a61c70932 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:09.509476 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-fdaeec23-a9dc-4c8a-bb33-311a61c70932 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action" status: 200 len: 38169 microversion: 2.1 time: 0.082979 Jan 18 16:41:09.510018 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 532/1071] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:41:09 2022] POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action => generated 38169 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:41:10.522735 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-a7cb97e4-8ccd-41b7-b113-d86217c6e32f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:41:10.523651 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-a7cb97e4-8ccd-41b7-b113-d86217c6e32f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:41:10.530433 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a7cb97e4-8ccd-41b7-b113-d86217c6e32f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:10.530878 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a7cb97e4-8ccd-41b7-b113-d86217c6e32f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:10.531653 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a7cb97e4-8ccd-41b7-b113-d86217c6e32f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:10.532090 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a7cb97e4-8ccd-41b7-b113-d86217c6e32f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:10.604056 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-a7cb97e4-8ccd-41b7-b113-d86217c6e32f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action" status: 200 len: 38169 microversion: 2.1 time: 0.086285 Jan 18 16:41:10.604714 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 540/1072] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:41:10 2022] POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action => generated 38169 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:41:11.618009 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-b17ed506-909a-4f09-8d88-bd334ec2e9fe tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:41:11.618927 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-b17ed506-909a-4f09-8d88-bd334ec2e9fe tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:41:11.626155 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-b17ed506-909a-4f09-8d88-bd334ec2e9fe tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:11.626608 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-b17ed506-909a-4f09-8d88-bd334ec2e9fe tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:11.627398 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-b17ed506-909a-4f09-8d88-bd334ec2e9fe tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:11.627835 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-b17ed506-909a-4f09-8d88-bd334ec2e9fe tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:11.687909 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-b17ed506-909a-4f09-8d88-bd334ec2e9fe tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action" status: 200 len: 38169 microversion: 2.1 time: 0.075373 Jan 18 16:41:11.688596 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 533/1073] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:41:11 2022] POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action => generated 38169 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:41:12.700465 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-7b491d7b-073f-4fa1-870e-f86fd6530244 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:41:12.701503 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-7b491d7b-073f-4fa1-870e-f86fd6530244 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:41:12.709096 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7b491d7b-073f-4fa1-870e-f86fd6530244 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:12.709552 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7b491d7b-073f-4fa1-870e-f86fd6530244 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:12.710339 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7b491d7b-073f-4fa1-870e-f86fd6530244 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:12.710774 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7b491d7b-073f-4fa1-870e-f86fd6530244 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:12.772723 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-7b491d7b-073f-4fa1-870e-f86fd6530244 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action" status: 200 len: 38169 microversion: 2.1 time: 0.076215 Jan 18 16:41:12.773386 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 541/1074] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:41:12 2022] POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action => generated 38169 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:41:13.785631 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-9e69ce18-5a66-4723-9aac-5f2f414e052d tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:41:13.787240 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-9e69ce18-5a66-4723-9aac-5f2f414e052d tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:41:13.794756 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-9e69ce18-5a66-4723-9aac-5f2f414e052d tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:13.795277 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-9e69ce18-5a66-4723-9aac-5f2f414e052d tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:13.796141 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-9e69ce18-5a66-4723-9aac-5f2f414e052d tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:13.796619 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-9e69ce18-5a66-4723-9aac-5f2f414e052d tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:13.867463 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-9e69ce18-5a66-4723-9aac-5f2f414e052d tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action" status: 200 len: 38300 microversion: 2.1 time: 0.086566 Jan 18 16:41:13.868112 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 534/1075] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Jan 18 16:41:13 2022] POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/action => generated 38300 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 16:41:13.878183 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-67c1b301-52e3-4cf3-81a8-8f96acd54abd tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:41:13.878761 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-67c1b301-52e3-4cf3-81a8-8f96acd54abd tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:41:13.887514 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-67c1b301-52e3-4cf3-81a8-8f96acd54abd tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:13.887969 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-67c1b301-52e3-4cf3-81a8-8f96acd54abd tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:13.888742 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-67c1b301-52e3-4cf3-81a8-8f96acd54abd tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:13.889206 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-67c1b301-52e3-4cf3-81a8-8f96acd54abd tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:13.913679 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-67c1b301-52e3-4cf3-81a8-8f96acd54abd tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/ips" status: 200 len: 146 microversion: 2.1 time: 0.039434 Jan 18 16:41:13.914246 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 542/1076] 10.222.0.82 () {58 vars in 1247 bytes} [Tue Jan 18 16:41:13 2022] GET /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:41:15.224197 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-2493f4a5-c8d1-4024-90f2-8ac1cbc1128f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c7c5fc7-c59e-40ce-b63c-60ecf98fda9b"}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:41:15.225467 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-2493f4a5-c8d1-4024-90f2-8ac1cbc1128f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:41:15.232477 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-2493f4a5-c8d1-4024-90f2-8ac1cbc1128f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:15.232952 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-2493f4a5-c8d1-4024-90f2-8ac1cbc1128f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:15.233747 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-2493f4a5-c8d1-4024-90f2-8ac1cbc1128f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:15.234185 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-2493f4a5-c8d1-4024-90f2-8ac1cbc1128f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:15.465900 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-2493f4a5-c8d1-4024-90f2-8ac1cbc1128f tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.245967 Jan 18 16:41:15.466586 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 535/1077] 10.222.0.82 () {60 vars in 1322 bytes} [Tue Jan 18 16:41:15 2022] POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/os-volume_attachments => generated 194 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:41:21.878409 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-4d75963b-ab1f-4ab6-9b78-14df5928c1f2 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:41:21.879310 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-4d75963b-ab1f-4ab6-9b78-14df5928c1f2 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:41:21.886428 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4d75963b-ab1f-4ab6-9b78-14df5928c1f2 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:21.886869 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4d75963b-ab1f-4ab6-9b78-14df5928c1f2 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:21.887637 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4d75963b-ab1f-4ab6-9b78-14df5928c1f2 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:21.888069 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4d75963b-ab1f-4ab6-9b78-14df5928c1f2 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:21.919475 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-4d75963b-ab1f-4ab6-9b78-14df5928c1f2 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044733 Jan 18 16:41:21.920033 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 543/1078] 10.222.0.82 () {58 vars in 1301 bytes} [Tue Jan 18 16:41:21 2022] GET /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:41:21.930676 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-f10c2b2e-f136-49c2-8474-67838e9ccfad tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:41:21.931257 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-f10c2b2e-f136-49c2-8474-67838e9ccfad tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:41:21.937333 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f10c2b2e-f136-49c2-8474-67838e9ccfad tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:21.937773 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f10c2b2e-f136-49c2-8474-67838e9ccfad tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:21.938556 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f10c2b2e-f136-49c2-8474-67838e9ccfad tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:21.938995 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f10c2b2e-f136-49c2-8474-67838e9ccfad tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:21.969859 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-f10c2b2e-f136-49c2-8474-67838e9ccfad tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/os-volume_attachments/6c7c5fc7-c59e-40ce-b63c-60ecf98fda9b" status: 200 len: 194 microversion: 2.1 time: 0.043874 Jan 18 16:41:21.970448 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 536/1079] 10.222.0.82 () {58 vars in 1412 bytes} [Tue Jan 18 16:41:21 2022] GET /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/os-volume_attachments/6c7c5fc7-c59e-40ce-b63c-60ecf98fda9b => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:41:23.266713 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-8b45fed0-118a-4b7c-b941-5cb5635de2a5 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8f9f6c9e-0e05-4f8f-9ed0-20ba239ff3e6"}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:41:23.267857 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-8b45fed0-118a-4b7c-b941-5cb5635de2a5 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:41:23.274719 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-8b45fed0-118a-4b7c-b941-5cb5635de2a5 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:23.275167 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-8b45fed0-118a-4b7c-b941-5cb5635de2a5 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:23.275946 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-8b45fed0-118a-4b7c-b941-5cb5635de2a5 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:23.276384 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-8b45fed0-118a-4b7c-b941-5cb5635de2a5 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:23.503059 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-8b45fed0-118a-4b7c-b941-5cb5635de2a5 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.239849 Jan 18 16:41:23.503665 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 544/1080] 10.222.0.82 () {60 vars in 1322 bytes} [Tue Jan 18 16:41:23 2022] POST /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/os-volume_attachments => generated 194 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:41:29.932448 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-dc2a00e2-a2a6-4f19-8859-56fb8ee0f78e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:41:29.933437 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-dc2a00e2-a2a6-4f19-8859-56fb8ee0f78e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:41:29.939572 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-dc2a00e2-a2a6-4f19-8859-56fb8ee0f78e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:29.940016 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-dc2a00e2-a2a6-4f19-8859-56fb8ee0f78e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:29.941075 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-dc2a00e2-a2a6-4f19-8859-56fb8ee0f78e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:29.941509 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-dc2a00e2-a2a6-4f19-8859-56fb8ee0f78e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:29.970915 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-dc2a00e2-a2a6-4f19-8859-56fb8ee0f78e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042108 Jan 18 16:41:29.971464 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 537/1081] 10.222.0.82 () {58 vars in 1301 bytes} [Tue Jan 18 16:41:29 2022] GET /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:41:30.218190 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-b00623db-64ba-4543-bf37-026f53b638a2 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:41:30.218775 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-b00623db-64ba-4543-bf37-026f53b638a2 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:41:30.225208 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-b00623db-64ba-4543-bf37-026f53b638a2 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:30.225651 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-b00623db-64ba-4543-bf37-026f53b638a2 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:30.226430 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-b00623db-64ba-4543-bf37-026f53b638a2 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:30.226856 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-b00623db-64ba-4543-bf37-026f53b638a2 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:30.257613 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-b00623db-64ba-4543-bf37-026f53b638a2 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/os-volume_attachments/6c7c5fc7-c59e-40ce-b63c-60ecf98fda9b" status: 200 len: 194 microversion: 2.1 time: 0.045095 Jan 18 16:41:30.258249 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 545/1082] 10.222.0.82 () {58 vars in 1412 bytes} [Tue Jan 18 16:41:30 2022] GET /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/os-volume_attachments/6c7c5fc7-c59e-40ce-b63c-60ecf98fda9b => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:41:30.267672 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-f511494d-8d89-4df9-9951-66d0d7ce0c12 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:41:30.268154 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-f511494d-8d89-4df9-9951-66d0d7ce0c12 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:41:30.275079 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f511494d-8d89-4df9-9951-66d0d7ce0c12 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:30.275524 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f511494d-8d89-4df9-9951-66d0d7ce0c12 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:30.276288 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f511494d-8d89-4df9-9951-66d0d7ce0c12 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:30.276716 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f511494d-8d89-4df9-9951-66d0d7ce0c12 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:30.354751 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.objects.instance [None req-f511494d-8d89-4df9-9951-66d0d7ce0c12 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lazy-loading 'services' on Instance uuid 10de432b-ed46-41a0-a765-34dd8daf0c4e {{(pid=116368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 18 16:41:30.423036 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-f511494d-8d89-4df9-9951-66d0d7ce0c12 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "DELETE /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/os-volume_attachments/6c7c5fc7-c59e-40ce-b63c-60ecf98fda9b" status: 202 len: 0 microversion: 2.1 time: 0.159058 Jan 18 16:41:30.423665 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 538/1083] 10.222.0.82 () {58 vars in 1415 bytes} [Tue Jan 18 16:41:30 2022] DELETE /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/os-volume_attachments/6c7c5fc7-c59e-40ce-b63c-60ecf98fda9b => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:41:31.529325 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-e53cd563-bd00-49c9-80fa-e0a4e0f05a89 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:41:31.529825 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-e53cd563-bd00-49c9-80fa-e0a4e0f05a89 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:41:31.536088 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e53cd563-bd00-49c9-80fa-e0a4e0f05a89 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:31.536538 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e53cd563-bd00-49c9-80fa-e0a4e0f05a89 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:31.537955 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e53cd563-bd00-49c9-80fa-e0a4e0f05a89 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:31.538475 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e53cd563-bd00-49c9-80fa-e0a4e0f05a89 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:31.566473 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-e53cd563-bd00-49c9-80fa-e0a4e0f05a89 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/os-volume_attachments/8f9f6c9e-0e05-4f8f-9ed0-20ba239ff3e6" status: 200 len: 194 microversion: 2.1 time: 0.040884 Jan 18 16:41:31.567057 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 546/1084] 10.222.0.82 () {58 vars in 1412 bytes} [Tue Jan 18 16:41:31 2022] GET /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/os-volume_attachments/8f9f6c9e-0e05-4f8f-9ed0-20ba239ff3e6 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:41:31.578044 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-da38e1b8-dd4d-4e14-8489-1af4149832f7 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:41:31.578627 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-da38e1b8-dd4d-4e14-8489-1af4149832f7 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:41:31.585312 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-da38e1b8-dd4d-4e14-8489-1af4149832f7 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:31.585748 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-da38e1b8-dd4d-4e14-8489-1af4149832f7 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:31.586529 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-da38e1b8-dd4d-4e14-8489-1af4149832f7 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:31.586969 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-da38e1b8-dd4d-4e14-8489-1af4149832f7 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:31.662397 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.objects.instance [None req-da38e1b8-dd4d-4e14-8489-1af4149832f7 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lazy-loading 'services' on Instance uuid 10de432b-ed46-41a0-a765-34dd8daf0c4e {{(pid=116368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 18 16:41:31.730776 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-da38e1b8-dd4d-4e14-8489-1af4149832f7 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "DELETE /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/os-volume_attachments/8f9f6c9e-0e05-4f8f-9ed0-20ba239ff3e6" status: 202 len: 0 microversion: 2.1 time: 0.157113 Jan 18 16:41:31.731424 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 539/1085] 10.222.0.82 () {58 vars in 1415 bytes} [Tue Jan 18 16:41:31 2022] DELETE /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/os-volume_attachments/8f9f6c9e-0e05-4f8f-9ed0-20ba239ff3e6 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:41:32.879381 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-32dd4c7d-7713-40c9-a9ae-59803b670c6c tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:41:32.880291 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-32dd4c7d-7713-40c9-a9ae-59803b670c6c tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:41:32.887183 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-32dd4c7d-7713-40c9-a9ae-59803b670c6c tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:32.887633 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-32dd4c7d-7713-40c9-a9ae-59803b670c6c tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:32.888417 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-32dd4c7d-7713-40c9-a9ae-59803b670c6c tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:32.888857 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-32dd4c7d-7713-40c9-a9ae-59803b670c6c tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:32.916427 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-32dd4c7d-7713-40c9-a9ae-59803b670c6c tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040825 Jan 18 16:41:32.916993 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 547/1086] 10.222.0.82 () {58 vars in 1301 bytes} [Tue Jan 18 16:41:32 2022] GET /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 18 16:41:33.019663 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-b382e941-703b-4acf-b5b9-7f681e4c8824 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:41:33.020649 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-b382e941-703b-4acf-b5b9-7f681e4c8824 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:41:33.027407 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-b382e941-703b-4acf-b5b9-7f681e4c8824 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:33.027851 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-b382e941-703b-4acf-b5b9-7f681e4c8824 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:33.028627 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-b382e941-703b-4acf-b5b9-7f681e4c8824 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:33.029094 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-b382e941-703b-4acf-b5b9-7f681e4c8824 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:33.058405 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-b382e941-703b-4acf-b5b9-7f681e4c8824 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045729 Jan 18 16:41:33.058878 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 540/1087] 10.222.0.82 () {58 vars in 1301 bytes} [Tue Jan 18 16:41:33 2022] GET /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 18 16:41:33.114190 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-e4858375-3b8a-4d3f-a628-69f0cf8ee2f4 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:41:33.114692 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-e4858375-3b8a-4d3f-a628-69f0cf8ee2f4 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:41:33.121200 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e4858375-3b8a-4d3f-a628-69f0cf8ee2f4 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:33.121653 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e4858375-3b8a-4d3f-a628-69f0cf8ee2f4 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:33.122432 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e4858375-3b8a-4d3f-a628-69f0cf8ee2f4 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:33.122893 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-e4858375-3b8a-4d3f-a628-69f0cf8ee2f4 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:33.147978 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-e4858375-3b8a-4d3f-a628-69f0cf8ee2f4 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Going to try to terminate instance {{(pid=116367) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 18 16:41:33.224128 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-e4858375-3b8a-4d3f-a628-69f0cf8ee2f4 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "DELETE /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e" status: 204 len: 0 microversion: 2.1 time: 0.113345 Jan 18 16:41:33.224876 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 548/1088] 10.222.0.82 () {58 vars in 1238 bytes} [Tue Jan 18 16:41:33 2022] DELETE /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 18 16:41:33.233584 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-301bd648-28d1-4809-b812-d25672b59054 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:41:33.234311 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-301bd648-28d1-4809-b812-d25672b59054 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:41:33.240829 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-301bd648-28d1-4809-b812-d25672b59054 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:33.241319 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-301bd648-28d1-4809-b812-d25672b59054 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:33.242113 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-301bd648-28d1-4809-b812-d25672b59054 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:33.242553 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-301bd648-28d1-4809-b812-d25672b59054 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:33.376377 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-301bd648-28d1-4809-b812-d25672b59054 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:41:33.384452 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-301bd648-28d1-4809-b812-d25672b59054 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e" status: 200 len: 1675 microversion: 2.1 time: 0.154779 Jan 18 16:41:33.385078 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 541/1089] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:41:33 2022] GET /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:41:34.402557 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-c4fa71b7-1af0-46ba-b4ec-9e0b66ee41c4 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:41:34.403244 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-c4fa71b7-1af0-46ba-b4ec-9e0b66ee41c4 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:41:34.409425 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c4fa71b7-1af0-46ba-b4ec-9e0b66ee41c4 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:34.409864 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c4fa71b7-1af0-46ba-b4ec-9e0b66ee41c4 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:34.410632 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c4fa71b7-1af0-46ba-b4ec-9e0b66ee41c4 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:34.411057 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c4fa71b7-1af0-46ba-b4ec-9e0b66ee41c4 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:34.540014 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-c4fa71b7-1af0-46ba-b4ec-9e0b66ee41c4 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:41:34.547217 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-c4fa71b7-1af0-46ba-b4ec-9e0b66ee41c4 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e" status: 200 len: 1675 microversion: 2.1 time: 0.148726 Jan 18 16:41:34.547775 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 549/1090] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:41:34 2022] GET /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e => generated 1675 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:41:35.564246 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-238fe369-b9e8-453c-bf4c-4d726d248b13 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:41:35.564871 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-238fe369-b9e8-453c-bf4c-4d726d248b13 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:41:35.571335 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-238fe369-b9e8-453c-bf4c-4d726d248b13 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:35.571783 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-238fe369-b9e8-453c-bf4c-4d726d248b13 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:35.572560 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-238fe369-b9e8-453c-bf4c-4d726d248b13 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:35.573010 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-238fe369-b9e8-453c-bf4c-4d726d248b13 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:35.772572 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-238fe369-b9e8-453c-bf4c-4d726d248b13 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeeb75184240ce9c0c17fc54e6eb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7c9d7399db4865a899d61aa89b988d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:41:35.779908 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-238fe369-b9e8-453c-bf4c-4d726d248b13 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e" status: 200 len: 1675 microversion: 2.1 time: 0.219336 Jan 18 16:41:35.780477 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 542/1091] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:41:35 2022] GET /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e => generated 1675 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:41:36.223944 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [req-f11df70e-6080-45b2-a073-f6410c0fb4c1 req-077dca28-da2f-446c-8bc0-f969f796adfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10de432b-ed46-41a0-a765-34dd8daf0c4e", "name": "network-vif-deleted", "tag": "1130cdbc-16e1-43cb-8f5f-965c89cef3af"}]} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:41:36.226052 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:41:36.226052 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: warnings.warn(msg) Jan 18 16:41:36.244880 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-f11df70e-6080-45b2-a073-f6410c0fb4c1 req-077dca28-da2f-446c-8bc0-f969f796adfc service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:36.245319 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-f11df70e-6080-45b2-a073-f6410c0fb4c1 req-077dca28-da2f-446c-8bc0-f969f796adfc service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:36.261226 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.compute.server_external_events [req-f11df70e-6080-45b2-a073-f6410c0fb4c1 req-077dca28-da2f-446c-8bc0-f969f796adfc service nova] Creating event network-vif-deleted:1130cdbc-16e1-43cb-8f5f-965c89cef3af for instance 10de432b-ed46-41a0-a765-34dd8daf0c4e on hv-cinder-78836 Jan 18 16:41:36.266573 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [req-f11df70e-6080-45b2-a073-f6410c0fb4c1 req-077dca28-da2f-446c-8bc0-f969f796adfc service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113860 Jan 18 16:41:36.273657 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 550/1092] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:41:36.797855 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-aa9e0764-3d20-433a-8f87-604d9431e460 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:41:36.798411 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-aa9e0764-3d20-433a-8f87-604d9431e460 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:41:36.805455 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-aa9e0764-3d20-433a-8f87-604d9431e460 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:36.805906 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-aa9e0764-3d20-433a-8f87-604d9431e460 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:36.806696 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-aa9e0764-3d20-433a-8f87-604d9431e460 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:36.807145 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-aa9e0764-3d20-433a-8f87-604d9431e460 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:36.821419 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.wsgi [None req-aa9e0764-3d20-433a-8f87-604d9431e460 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] HTTP exception thrown: Instance 10de432b-ed46-41a0-a765-34dd8daf0c4e could not be found. Jan 18 16:41:36.822012 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-aa9e0764-3d20-433a-8f87-604d9431e460 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Returning 404 to user: Instance 10de432b-ed46-41a0-a765-34dd8daf0c4e could not be found. {{(pid=116368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 16:41:36.822829 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-aa9e0764-3d20-433a-8f87-604d9431e460 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e" status: 404 len: 111 microversion: 2.1 time: 0.028977 Jan 18 16:41:36.823368 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 543/1093] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:41:36 2022] GET /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 16:41:36.831986 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-00e514f6-64be-490b-a994-71b83287877e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '.version_select at 0x7f33a54d25e0>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:41:36.850172 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-00e514f6-64be-490b-a994-71b83287877e tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1733782697" status: 202 len: 0 microversion: 2.1 time: 0.021566 Jan 18 16:41:36.850981 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 551/1094] 10.222.0.82 () {58 vars in 1220 bytes} [Tue Jan 18 16:41:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1733782697 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:41:39.727521 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-41c0baba-d78c-4d73-8fc0-fd9cb478b53b tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:41:39.728059 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-41c0baba-d78c-4d73-8fc0-fd9cb478b53b tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:41:39.734264 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-41c0baba-d78c-4d73-8fc0-fd9cb478b53b tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:39.734715 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-41c0baba-d78c-4d73-8fc0-fd9cb478b53b tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:39.735494 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-41c0baba-d78c-4d73-8fc0-fd9cb478b53b tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:39.735932 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-41c0baba-d78c-4d73-8fc0-fd9cb478b53b tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:39.750670 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.wsgi [None req-41c0baba-d78c-4d73-8fc0-fd9cb478b53b tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] HTTP exception thrown: Instance 10de432b-ed46-41a0-a765-34dd8daf0c4e could not be found. Jan 18 16:41:39.751251 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-41c0baba-d78c-4d73-8fc0-fd9cb478b53b tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Returning 404 to user: Instance 10de432b-ed46-41a0-a765-34dd8daf0c4e could not be found. {{(pid=116368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 16:41:39.752067 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-41c0baba-d78c-4d73-8fc0-fd9cb478b53b tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "DELETE /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e" status: 404 len: 111 microversion: 2.1 time: 0.029146 Jan 18 16:41:39.752593 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 544/1095] 10.222.0.82 () {58 vars in 1238 bytes} [Tue Jan 18 16:41:39 2022] DELETE /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 16:41:39.761430 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-21dfe886-b771-4bd6-ad4a-25d332a58411 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:41:39.762154 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-21dfe886-b771-4bd6-ad4a-25d332a58411 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 10de432b-ed46-41a0-a765-34dd8daf0c4e] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:41:39.768121 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-21dfe886-b771-4bd6-ad4a-25d332a58411 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:39.768566 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-21dfe886-b771-4bd6-ad4a-25d332a58411 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:39.769362 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-21dfe886-b771-4bd6-ad4a-25d332a58411 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:39.769795 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-21dfe886-b771-4bd6-ad4a-25d332a58411 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:39.785164 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.wsgi [None req-21dfe886-b771-4bd6-ad4a-25d332a58411 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] HTTP exception thrown: Instance 10de432b-ed46-41a0-a765-34dd8daf0c4e could not be found. Jan 18 16:41:39.785755 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-21dfe886-b771-4bd6-ad4a-25d332a58411 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Returning 404 to user: Instance 10de432b-ed46-41a0-a765-34dd8daf0c4e could not be found. {{(pid=116367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 16:41:39.787055 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-21dfe886-b771-4bd6-ad4a-25d332a58411 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e" status: 404 len: 111 microversion: 2.1 time: 0.029349 Jan 18 16:41:39.787769 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 552/1096] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:41:39 2022] GET /compute/v2.1/servers/10de432b-ed46-41a0-a765-34dd8daf0c4e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 16:41:40.911773 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-75d91af1-0d73-4650-9173-20cfda22213c tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:41:40.912629 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-75d91af1-0d73-4650-9173-20cfda22213c tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:41:40.918393 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-75d91af1-0d73-4650-9173-20cfda22213c tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:40.918840 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-75d91af1-0d73-4650-9173-20cfda22213c tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:40.919621 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-75d91af1-0d73-4650-9173-20cfda22213c tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:40.920058 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-75d91af1-0d73-4650-9173-20cfda22213c tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:40.933481 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.wsgi [None req-75d91af1-0d73-4650-9173-20cfda22213c tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] HTTP exception thrown: Instance 7c365b3e-1a90-40d6-8269-84bbf61e7515 could not be found. Jan 18 16:41:40.934053 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-75d91af1-0d73-4650-9173-20cfda22213c tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Returning 404 to user: Instance 7c365b3e-1a90-40d6-8269-84bbf61e7515 could not be found. {{(pid=116368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 16:41:40.934858 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-75d91af1-0d73-4650-9173-20cfda22213c tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "DELETE /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515" status: 404 len: 111 microversion: 2.1 time: 0.026811 Jan 18 16:41:40.935378 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 545/1097] 10.222.0.82 () {58 vars in 1238 bytes} [Tue Jan 18 16:41:40 2022] DELETE /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 16:41:40.944413 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-53ee0c7c-7636-4e6f-a2e3-e2c66f94e282 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:41:40.945579 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-53ee0c7c-7636-4e6f-a2e3-e2c66f94e282 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] [instance: 7c365b3e-1a90-40d6-8269-84bbf61e7515] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:41:40.951976 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-53ee0c7c-7636-4e6f-a2e3-e2c66f94e282 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:40.952420 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-53ee0c7c-7636-4e6f-a2e3-e2c66f94e282 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:40.953224 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-53ee0c7c-7636-4e6f-a2e3-e2c66f94e282 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:40.953685 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-53ee0c7c-7636-4e6f-a2e3-e2c66f94e282 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:40.967958 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.wsgi [None req-53ee0c7c-7636-4e6f-a2e3-e2c66f94e282 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] HTTP exception thrown: Instance 7c365b3e-1a90-40d6-8269-84bbf61e7515 could not be found. Jan 18 16:41:40.968532 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-53ee0c7c-7636-4e6f-a2e3-e2c66f94e282 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] Returning 404 to user: Instance 7c365b3e-1a90-40d6-8269-84bbf61e7515 could not be found. {{(pid=116367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 16:41:40.969367 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-53ee0c7c-7636-4e6f-a2e3-e2c66f94e282 tempest-AttachVolumeTestJSON-2075558073 tempest-AttachVolumeTestJSON-2075558073-project] 10.222.0.82 "GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515" status: 404 len: 111 microversion: 2.1 time: 0.029968 Jan 18 16:41:40.969884 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 553/1098] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:41:40 2022] GET /compute/v2.1/servers/7c365b3e-1a90-40d6-8269-84bbf61e7515 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 16:41:45.908131 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-698d1b55-7d30-4421-8c90-4e4a5219e360 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-176862841", "imageRef": "900c4a9d-b6c6-451f-a509-eb4f4b49f459", "flavorRef": "452", "networks": [{"uuid": "3b3b985b-c3d6-45d3-ad06-0901ba978884"}]}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:41:45.959135 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.network.neutron [None req-698d1b55-7d30-4421-8c90-4e4a5219e360 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] validate_networks() for [('3b3b985b-c3d6-45d3-ad06-0901ba978884', None, None, None, None, None)] {{(pid=116368) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 18 16:41:46.341190 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-698d1b55-7d30-4421-8c90-4e4a5219e360 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Flavor limits 0:0:0 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 18 16:41:46.341614 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-698d1b55-7d30-4421-8c90-4e4a5219e360 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Image limits 0:0:0 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 18 16:41:46.342082 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-698d1b55-7d30-4421-8c90-4e4a5219e360 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Flavor pref 0:0:0 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 18 16:41:46.342486 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-698d1b55-7d30-4421-8c90-4e4a5219e360 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Image pref 0:0:0 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 18 16:41:46.342924 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-698d1b55-7d30-4421-8c90-4e4a5219e360 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 18 16:41:46.351659 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-698d1b55-7d30-4421-8c90-4e4a5219e360 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:46.352101 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-698d1b55-7d30-4421-8c90-4e4a5219e360 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:46.352911 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-698d1b55-7d30-4421-8c90-4e4a5219e360 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:46.353374 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-698d1b55-7d30-4421-8c90-4e4a5219e360 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:46.369817 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.quota [None req-698d1b55-7d30-4421-8c90-4e4a5219e360 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Getting quotas for project 83cee5b17bce4fc186700e306378f767. Resources: {'ram', 'instances', 'cores'} {{(pid=116368) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 16:41:46.373653 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.quota [None req-698d1b55-7d30-4421-8c90-4e4a5219e360 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Getting quotas for user e1f30f1ddb7249b5a7551464a7ab48fc and project 83cee5b17bce4fc186700e306378f767. Resources: {'ram', 'instances', 'cores'} {{(pid=116368) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 16:41:46.384880 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-698d1b55-7d30-4421-8c90-4e4a5219e360 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Going to run 1 instances... {{(pid=116368) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 18 16:41:46.387147 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-698d1b55-7d30-4421-8c90-4e4a5219e360 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: c9d430db-b5ab-4c0e-add0-a4abe3607e9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='900c4a9d-b6c6-451f-a509-eb4f4b49f459',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116368) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 18 16:41:46.429560 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-698d1b55-7d30-4421-8c90-4e4a5219e360 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.631840 Jan 18 16:41:46.430195 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 546/1099] 10.222.0.82 () {60 vars in 1146 bytes} [Tue Jan 18 16:41:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 18 16:41:46.439710 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-2b1f7d1e-d762-4e58-a57f-19cefecc02ce tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:41:46.440576 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-2b1f7d1e-d762-4e58-a57f-19cefecc02ce tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: c9d430db-b5ab-4c0e-add0-a4abe3607e9c] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:41:46.492207 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-2b1f7d1e-d762-4e58-a57f-19cefecc02ce tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f30f1ddb7249b5a7551464a7ab48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cee5b17bce4fc186700e306378f767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:41:46.498794 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-2b1f7d1e-d762-4e58-a57f-19cefecc02ce tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "GET /compute/v2.1/servers/c9d430db-b5ab-4c0e-add0-a4abe3607e9c" status: 200 len: 1217 microversion: 2.1 time: 0.062685 Jan 18 16:41:46.499354 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 554/1100] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:41:46 2022] GET /compute/v2.1/servers/c9d430db-b5ab-4c0e-add0-a4abe3607e9c => generated 1217 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:41:47.516152 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-8d70efdf-ef34-4663-9a10-30790782f6be tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:41:47.516754 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-8d70efdf-ef34-4663-9a10-30790782f6be tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: c9d430db-b5ab-4c0e-add0-a4abe3607e9c] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:41:47.523544 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8d70efdf-ef34-4663-9a10-30790782f6be tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:47.523990 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8d70efdf-ef34-4663-9a10-30790782f6be tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:47.524765 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8d70efdf-ef34-4663-9a10-30790782f6be tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:47.525216 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8d70efdf-ef34-4663-9a10-30790782f6be tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:47.601160 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-8d70efdf-ef34-4663-9a10-30790782f6be tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f30f1ddb7249b5a7551464a7ab48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cee5b17bce4fc186700e306378f767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:41:47.608321 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-8d70efdf-ef34-4663-9a10-30790782f6be tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "GET /compute/v2.1/servers/c9d430db-b5ab-4c0e-add0-a4abe3607e9c" status: 200 len: 1275 microversion: 2.1 time: 0.096307 Jan 18 16:41:47.608873 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 547/1101] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:41:47 2022] GET /compute/v2.1/servers/c9d430db-b5ab-4c0e-add0-a4abe3607e9c => generated 1275 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:41:48.550612 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [req-ac486337-e8cf-41f5-ae97-cb2ac3a02387 req-a4a913c5-8798-4cb2-8bda-991389ac9604 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9d430db-b5ab-4c0e-add0-a4abe3607e9c", "tag": "4ab2fb4e-fd27-4ffa-89a9-7b5cd49ceaf3"}]} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:41:48.552374 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:41:48.552374 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: warnings.warn(msg) Jan 18 16:41:48.560359 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-ac486337-e8cf-41f5-ae97-cb2ac3a02387 req-a4a913c5-8798-4cb2-8bda-991389ac9604 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:48.560804 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-ac486337-e8cf-41f5-ae97-cb2ac3a02387 req-a4a913c5-8798-4cb2-8bda-991389ac9604 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:48.571507 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.compute.server_external_events [req-ac486337-e8cf-41f5-ae97-cb2ac3a02387 req-a4a913c5-8798-4cb2-8bda-991389ac9604 service nova] Creating event network-changed:4ab2fb4e-fd27-4ffa-89a9-7b5cd49ceaf3 for instance c9d430db-b5ab-4c0e-add0-a4abe3607e9c on hv-cinder-78836 Jan 18 16:41:48.576288 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [req-ac486337-e8cf-41f5-ae97-cb2ac3a02387 req-a4a913c5-8798-4cb2-8bda-991389ac9604 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029301 Jan 18 16:41:48.576896 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 555/1102] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:41:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:41:48.627215 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-04c4d78a-729e-4001-bc74-76d39d443464 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:41:48.627831 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-04c4d78a-729e-4001-bc74-76d39d443464 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: c9d430db-b5ab-4c0e-add0-a4abe3607e9c] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:41:48.633610 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-04c4d78a-729e-4001-bc74-76d39d443464 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:48.634068 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-04c4d78a-729e-4001-bc74-76d39d443464 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:48.634848 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-04c4d78a-729e-4001-bc74-76d39d443464 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:48.635282 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-04c4d78a-729e-4001-bc74-76d39d443464 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:48.873190 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-04c4d78a-729e-4001-bc74-76d39d443464 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f30f1ddb7249b5a7551464a7ab48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cee5b17bce4fc186700e306378f767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:41:48.881046 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-04c4d78a-729e-4001-bc74-76d39d443464 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "GET /compute/v2.1/servers/c9d430db-b5ab-4c0e-add0-a4abe3607e9c" status: 200 len: 1317 microversion: 2.1 time: 0.257992 Jan 18 16:41:48.881751 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 548/1103] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:41:48 2022] GET /compute/v2.1/servers/c9d430db-b5ab-4c0e-add0-a4abe3607e9c => generated 1317 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:41:49.899640 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-ebc077b5-221f-4047-bdc8-a344d0238fb5 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:41:49.900336 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-ebc077b5-221f-4047-bdc8-a344d0238fb5 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: c9d430db-b5ab-4c0e-add0-a4abe3607e9c] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:41:49.906807 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-ebc077b5-221f-4047-bdc8-a344d0238fb5 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:49.907255 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-ebc077b5-221f-4047-bdc8-a344d0238fb5 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:49.908071 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-ebc077b5-221f-4047-bdc8-a344d0238fb5 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:49.908504 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-ebc077b5-221f-4047-bdc8-a344d0238fb5 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:50.053652 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-ebc077b5-221f-4047-bdc8-a344d0238fb5 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f30f1ddb7249b5a7551464a7ab48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cee5b17bce4fc186700e306378f767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:41:50.060887 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-ebc077b5-221f-4047-bdc8-a344d0238fb5 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "GET /compute/v2.1/servers/c9d430db-b5ab-4c0e-add0-a4abe3607e9c" status: 200 len: 1317 microversion: 2.1 time: 0.167222 Jan 18 16:41:50.061470 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 556/1104] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:41:49 2022] GET /compute/v2.1/servers/c9d430db-b5ab-4c0e-add0-a4abe3607e9c => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:41:51.078313 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-90a0f94f-194d-48a3-9339-58d8d530f97b tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:41:51.078920 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-90a0f94f-194d-48a3-9339-58d8d530f97b tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: c9d430db-b5ab-4c0e-add0-a4abe3607e9c] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:41:51.085835 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-90a0f94f-194d-48a3-9339-58d8d530f97b tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:51.086282 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-90a0f94f-194d-48a3-9339-58d8d530f97b tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:51.087063 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-90a0f94f-194d-48a3-9339-58d8d530f97b tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:51.087503 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-90a0f94f-194d-48a3-9339-58d8d530f97b tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:51.218381 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-90a0f94f-194d-48a3-9339-58d8d530f97b tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f30f1ddb7249b5a7551464a7ab48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cee5b17bce4fc186700e306378f767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:41:51.226205 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-90a0f94f-194d-48a3-9339-58d8d530f97b tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "GET /compute/v2.1/servers/c9d430db-b5ab-4c0e-add0-a4abe3607e9c" status: 200 len: 1317 microversion: 2.1 time: 0.151618 Jan 18 16:41:51.227013 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 549/1105] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:41:51 2022] GET /compute/v2.1/servers/c9d430db-b5ab-4c0e-add0-a4abe3607e9c => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:41:52.243684 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-205bfb17-f4c2-40dd-a0b4-b98763dff22b tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:41:52.244284 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-205bfb17-f4c2-40dd-a0b4-b98763dff22b tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: c9d430db-b5ab-4c0e-add0-a4abe3607e9c] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:41:52.250737 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-205bfb17-f4c2-40dd-a0b4-b98763dff22b tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:52.251180 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-205bfb17-f4c2-40dd-a0b4-b98763dff22b tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:52.251954 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-205bfb17-f4c2-40dd-a0b4-b98763dff22b tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:52.252383 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-205bfb17-f4c2-40dd-a0b4-b98763dff22b tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:52.379833 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-205bfb17-f4c2-40dd-a0b4-b98763dff22b tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f30f1ddb7249b5a7551464a7ab48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cee5b17bce4fc186700e306378f767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:41:52.387733 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-205bfb17-f4c2-40dd-a0b4-b98763dff22b tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "GET /compute/v2.1/servers/c9d430db-b5ab-4c0e-add0-a4abe3607e9c" status: 200 len: 1317 microversion: 2.1 time: 0.148433 Jan 18 16:41:52.388324 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 557/1106] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:41:52 2022] GET /compute/v2.1/servers/c9d430db-b5ab-4c0e-add0-a4abe3607e9c => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:41:53.313906 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [req-93640e26-e1e8-4598-ad63-905634744019 req-f5bd6f5f-9d9f-4d2e-8688-2d31ecc97fab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9d430db-b5ab-4c0e-add0-a4abe3607e9c", "name": "network-vif-plugged", "status": "completed", "tag": "4ab2fb4e-fd27-4ffa-89a9-7b5cd49ceaf3"}]} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:41:53.315787 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:41:53.315787 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: warnings.warn(msg) Jan 18 16:41:53.322649 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-93640e26-e1e8-4598-ad63-905634744019 req-f5bd6f5f-9d9f-4d2e-8688-2d31ecc97fab service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:53.323089 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-93640e26-e1e8-4598-ad63-905634744019 req-f5bd6f5f-9d9f-4d2e-8688-2d31ecc97fab service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:53.333832 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.compute.server_external_events [req-93640e26-e1e8-4598-ad63-905634744019 req-f5bd6f5f-9d9f-4d2e-8688-2d31ecc97fab service nova] Creating event network-vif-plugged:4ab2fb4e-fd27-4ffa-89a9-7b5cd49ceaf3 for instance c9d430db-b5ab-4c0e-add0-a4abe3607e9c on hv-cinder-78836 Jan 18 16:41:53.338634 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [req-93640e26-e1e8-4598-ad63-905634744019 req-f5bd6f5f-9d9f-4d2e-8688-2d31ecc97fab service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085018 Jan 18 16:41:53.339275 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 550/1107] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:41:53.404134 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-50b33011-c7dc-4e8e-ac4a-f2df3e06cffc tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:41:53.404714 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-50b33011-c7dc-4e8e-ac4a-f2df3e06cffc tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: c9d430db-b5ab-4c0e-add0-a4abe3607e9c] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:41:53.410870 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-50b33011-c7dc-4e8e-ac4a-f2df3e06cffc tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:53.411877 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-50b33011-c7dc-4e8e-ac4a-f2df3e06cffc tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:53.412698 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-50b33011-c7dc-4e8e-ac4a-f2df3e06cffc tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:53.413165 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-50b33011-c7dc-4e8e-ac4a-f2df3e06cffc tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:53.603824 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-50b33011-c7dc-4e8e-ac4a-f2df3e06cffc tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f30f1ddb7249b5a7551464a7ab48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cee5b17bce4fc186700e306378f767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:41:53.611602 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-50b33011-c7dc-4e8e-ac4a-f2df3e06cffc tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "GET /compute/v2.1/servers/c9d430db-b5ab-4c0e-add0-a4abe3607e9c" status: 200 len: 1317 microversion: 2.1 time: 0.211194 Jan 18 16:41:53.612166 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 558/1108] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:41:53 2022] GET /compute/v2.1/servers/c9d430db-b5ab-4c0e-add0-a4abe3607e9c => generated 1317 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:41:54.632070 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-f13195c9-fae5-42f4-91d6-d1b2b6470b10 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:41:54.632703 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-f13195c9-fae5-42f4-91d6-d1b2b6470b10 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: c9d430db-b5ab-4c0e-add0-a4abe3607e9c] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:41:54.638942 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f13195c9-fae5-42f4-91d6-d1b2b6470b10 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:54.639389 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f13195c9-fae5-42f4-91d6-d1b2b6470b10 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:54.640169 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f13195c9-fae5-42f4-91d6-d1b2b6470b10 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:54.640600 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f13195c9-fae5-42f4-91d6-d1b2b6470b10 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:54.779391 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-f13195c9-fae5-42f4-91d6-d1b2b6470b10 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f30f1ddb7249b5a7551464a7ab48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cee5b17bce4fc186700e306378f767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:41:54.787619 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-f13195c9-fae5-42f4-91d6-d1b2b6470b10 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "GET /compute/v2.1/servers/c9d430db-b5ab-4c0e-add0-a4abe3607e9c" status: 200 len: 1317 microversion: 2.1 time: 0.161851 Jan 18 16:41:54.788265 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 551/1109] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:41:54 2022] GET /compute/v2.1/servers/c9d430db-b5ab-4c0e-add0-a4abe3607e9c => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:41:55.804242 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-a7482d51-e6ea-4026-ae39-c15be3b497fe tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:41:55.804858 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-a7482d51-e6ea-4026-ae39-c15be3b497fe tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: c9d430db-b5ab-4c0e-add0-a4abe3607e9c] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:41:55.810995 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a7482d51-e6ea-4026-ae39-c15be3b497fe tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:55.811435 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a7482d51-e6ea-4026-ae39-c15be3b497fe tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:55.812203 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a7482d51-e6ea-4026-ae39-c15be3b497fe tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:55.812637 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a7482d51-e6ea-4026-ae39-c15be3b497fe tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:55.943565 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-a7482d51-e6ea-4026-ae39-c15be3b497fe tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f30f1ddb7249b5a7551464a7ab48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cee5b17bce4fc186700e306378f767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:41:55.951299 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-a7482d51-e6ea-4026-ae39-c15be3b497fe tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "GET /compute/v2.1/servers/c9d430db-b5ab-4c0e-add0-a4abe3607e9c" status: 200 len: 1507 microversion: 2.1 time: 0.150692 Jan 18 16:41:55.951923 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 559/1110] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:41:55 2022] GET /compute/v2.1/servers/c9d430db-b5ab-4c0e-add0-a4abe3607e9c => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:41:57.285401 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-9c5397e2-f9dd-45a4-a469-7372b5b7f65a tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52f0729d-82ec-4a4b-a4e5-4ae9e6e5a90d"}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:41:57.286513 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-9c5397e2-f9dd-45a4-a469-7372b5b7f65a tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: c9d430db-b5ab-4c0e-add0-a4abe3607e9c] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:41:57.292792 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-9c5397e2-f9dd-45a4-a469-7372b5b7f65a tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:57.293277 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-9c5397e2-f9dd-45a4-a469-7372b5b7f65a tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:57.294060 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-9c5397e2-f9dd-45a4-a469-7372b5b7f65a tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:41:57.294496 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-9c5397e2-f9dd-45a4-a469-7372b5b7f65a tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:41:57.521863 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-9c5397e2-f9dd-45a4-a469-7372b5b7f65a tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "POST /compute/v2.1/servers/c9d430db-b5ab-4c0e-add0-a4abe3607e9c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.239918 Jan 18 16:41:57.522492 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 552/1111] 10.222.0.82 () {60 vars in 1322 bytes} [Tue Jan 18 16:41:57 2022] POST /compute/v2.1/servers/c9d430db-b5ab-4c0e-add0-a4abe3607e9c/os-volume_attachments => generated 194 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:42:03.971219 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-52a39a31-b715-4aa2-a913-45336ba59672 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-458773556", "imageRef": "900c4a9d-b6c6-451f-a509-eb4f4b49f459", "flavorRef": "452", "networks": [{"uuid": "3b3b985b-c3d6-45d3-ad06-0901ba978884"}]}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:42:04.022533 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.network.neutron [None req-52a39a31-b715-4aa2-a913-45336ba59672 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] validate_networks() for [('3b3b985b-c3d6-45d3-ad06-0901ba978884', None, None, None, None, None)] {{(pid=116367) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 18 16:42:04.388386 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.virt.hardware [None req-52a39a31-b715-4aa2-a913-45336ba59672 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Flavor limits 0:0:0 {{(pid=116367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 18 16:42:04.388814 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.virt.hardware [None req-52a39a31-b715-4aa2-a913-45336ba59672 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Image limits 0:0:0 {{(pid=116367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 18 16:42:04.389320 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.virt.hardware [None req-52a39a31-b715-4aa2-a913-45336ba59672 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Flavor pref 0:0:0 {{(pid=116367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 18 16:42:04.389764 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.virt.hardware [None req-52a39a31-b715-4aa2-a913-45336ba59672 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Image pref 0:0:0 {{(pid=116367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 18 16:42:04.390219 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.virt.hardware [None req-52a39a31-b715-4aa2-a913-45336ba59672 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 18 16:42:04.399121 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-52a39a31-b715-4aa2-a913-45336ba59672 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:04.399571 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-52a39a31-b715-4aa2-a913-45336ba59672 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:04.400432 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-52a39a31-b715-4aa2-a913-45336ba59672 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:04.400878 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-52a39a31-b715-4aa2-a913-45336ba59672 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:04.416966 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.quota [None req-52a39a31-b715-4aa2-a913-45336ba59672 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Getting quotas for project 83cee5b17bce4fc186700e306378f767. Resources: {'ram', 'instances', 'cores'} {{(pid=116367) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 16:42:04.420998 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.quota [None req-52a39a31-b715-4aa2-a913-45336ba59672 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Getting quotas for user e1f30f1ddb7249b5a7551464a7ab48fc and project 83cee5b17bce4fc186700e306378f767. Resources: {'ram', 'instances', 'cores'} {{(pid=116367) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 16:42:04.432252 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-52a39a31-b715-4aa2-a913-45336ba59672 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Going to run 1 instances... {{(pid=116367) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 18 16:42:04.434579 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-52a39a31-b715-4aa2-a913-45336ba59672 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: 6622da12-a0e7-4ddc-b0eb-cdc5098937fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='900c4a9d-b6c6-451f-a509-eb4f4b49f459',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 18 16:42:04.479812 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-52a39a31-b715-4aa2-a913-45336ba59672 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.512190 Jan 18 16:42:04.480452 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 560/1112] 10.222.0.82 () {60 vars in 1146 bytes} [Tue Jan 18 16:42:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 513 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 18 16:42:04.492026 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-4e2bef13-81e1-4f7c-86fe-b717849693cc tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:42:04.492804 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-4e2bef13-81e1-4f7c-86fe-b717849693cc tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: 6622da12-a0e7-4ddc-b0eb-cdc5098937fb] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:42:04.545891 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-4e2bef13-81e1-4f7c-86fe-b717849693cc tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f30f1ddb7249b5a7551464a7ab48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cee5b17bce4fc186700e306378f767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:42:04.553213 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-4e2bef13-81e1-4f7c-86fe-b717849693cc tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "GET /compute/v2.1/servers/6622da12-a0e7-4ddc-b0eb-cdc5098937fb" status: 200 len: 1217 microversion: 2.1 time: 0.065831 Jan 18 16:42:04.554010 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 553/1113] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:42:04 2022] GET /compute/v2.1/servers/6622da12-a0e7-4ddc-b0eb-cdc5098937fb => generated 1217 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:42:05.571802 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-59476d17-f915-4ebf-99bc-a5052f69a47f tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:42:05.572549 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-59476d17-f915-4ebf-99bc-a5052f69a47f tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: 6622da12-a0e7-4ddc-b0eb-cdc5098937fb] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:42:05.579355 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-59476d17-f915-4ebf-99bc-a5052f69a47f tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:05.579799 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-59476d17-f915-4ebf-99bc-a5052f69a47f tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:05.580582 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-59476d17-f915-4ebf-99bc-a5052f69a47f tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:05.581040 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-59476d17-f915-4ebf-99bc-a5052f69a47f tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:05.657237 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-59476d17-f915-4ebf-99bc-a5052f69a47f tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f30f1ddb7249b5a7551464a7ab48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cee5b17bce4fc186700e306378f767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:42:05.664566 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-59476d17-f915-4ebf-99bc-a5052f69a47f tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "GET /compute/v2.1/servers/6622da12-a0e7-4ddc-b0eb-cdc5098937fb" status: 200 len: 1275 microversion: 2.1 time: 0.097921 Jan 18 16:42:05.665148 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 561/1114] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:42:05 2022] GET /compute/v2.1/servers/6622da12-a0e7-4ddc-b0eb-cdc5098937fb => generated 1275 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:42:06.671432 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [req-7b830d77-a1bb-42a3-bc1f-5f7dd82c9449 req-43afe6fe-1b28-4117-afc1-1307c4424da2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6622da12-a0e7-4ddc-b0eb-cdc5098937fb", "tag": "4e43b3a1-3e71-4876-b998-a471d3058d1f"}]} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:42:06.673155 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:42:06.673155 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: warnings.warn(msg) Jan 18 16:42:06.683754 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-7b830d77-a1bb-42a3-bc1f-5f7dd82c9449 req-43afe6fe-1b28-4117-afc1-1307c4424da2 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:06.684204 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-7b830d77-a1bb-42a3-bc1f-5f7dd82c9449 req-43afe6fe-1b28-4117-afc1-1307c4424da2 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:06.684535 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-b9921bb8-9837-4400-95b2-29067413a20d tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:42:06.695913 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.compute.server_external_events [req-7b830d77-a1bb-42a3-bc1f-5f7dd82c9449 req-43afe6fe-1b28-4117-afc1-1307c4424da2 service nova] Creating event network-changed:4e43b3a1-3e71-4876-b998-a471d3058d1f for instance 6622da12-a0e7-4ddc-b0eb-cdc5098937fb on hv-cinder-78836 Jan 18 16:42:06.696145 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-b9921bb8-9837-4400-95b2-29067413a20d tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: 6622da12-a0e7-4ddc-b0eb-cdc5098937fb] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:42:06.701375 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [req-7b830d77-a1bb-42a3-bc1f-5f7dd82c9449 req-43afe6fe-1b28-4117-afc1-1307c4424da2 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033619 Jan 18 16:42:06.702968 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 554/1115] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:42:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 16:42:06.703815 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-b9921bb8-9837-4400-95b2-29067413a20d tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:06.704410 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-b9921bb8-9837-4400-95b2-29067413a20d tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:06.706449 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-b9921bb8-9837-4400-95b2-29067413a20d tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:06.706954 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-b9921bb8-9837-4400-95b2-29067413a20d tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:06.921078 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-b9921bb8-9837-4400-95b2-29067413a20d tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f30f1ddb7249b5a7551464a7ab48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cee5b17bce4fc186700e306378f767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:42:06.929296 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-b9921bb8-9837-4400-95b2-29067413a20d tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "GET /compute/v2.1/servers/6622da12-a0e7-4ddc-b0eb-cdc5098937fb" status: 200 len: 1317 microversion: 2.1 time: 0.250355 Jan 18 16:42:06.930164 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 562/1116] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:42:06 2022] GET /compute/v2.1/servers/6622da12-a0e7-4ddc-b0eb-cdc5098937fb => generated 1317 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:42:07.946982 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-c17e3cae-e46d-4076-93f2-9eb96e2204b1 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:42:07.947682 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-c17e3cae-e46d-4076-93f2-9eb96e2204b1 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: 6622da12-a0e7-4ddc-b0eb-cdc5098937fb] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:42:07.953797 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c17e3cae-e46d-4076-93f2-9eb96e2204b1 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:07.954244 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c17e3cae-e46d-4076-93f2-9eb96e2204b1 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:07.955022 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c17e3cae-e46d-4076-93f2-9eb96e2204b1 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:07.955458 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c17e3cae-e46d-4076-93f2-9eb96e2204b1 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:08.084099 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-c17e3cae-e46d-4076-93f2-9eb96e2204b1 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f30f1ddb7249b5a7551464a7ab48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cee5b17bce4fc186700e306378f767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:42:08.091467 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-c17e3cae-e46d-4076-93f2-9eb96e2204b1 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "GET /compute/v2.1/servers/6622da12-a0e7-4ddc-b0eb-cdc5098937fb" status: 200 len: 1317 microversion: 2.1 time: 0.149592 Jan 18 16:42:08.092055 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 555/1117] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:42:07 2022] GET /compute/v2.1/servers/6622da12-a0e7-4ddc-b0eb-cdc5098937fb => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:42:09.107741 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-dab41678-e68e-411a-aebb-3bba1f8d278b tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:42:09.108354 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-dab41678-e68e-411a-aebb-3bba1f8d278b tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: 6622da12-a0e7-4ddc-b0eb-cdc5098937fb] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:42:09.115105 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-dab41678-e68e-411a-aebb-3bba1f8d278b tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:09.115646 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-dab41678-e68e-411a-aebb-3bba1f8d278b tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:09.116436 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-dab41678-e68e-411a-aebb-3bba1f8d278b tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:09.116859 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-dab41678-e68e-411a-aebb-3bba1f8d278b tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:09.248669 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-dab41678-e68e-411a-aebb-3bba1f8d278b tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f30f1ddb7249b5a7551464a7ab48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cee5b17bce4fc186700e306378f767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:42:09.257431 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-dab41678-e68e-411a-aebb-3bba1f8d278b tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "GET /compute/v2.1/servers/6622da12-a0e7-4ddc-b0eb-cdc5098937fb" status: 200 len: 1317 microversion: 2.1 time: 0.153284 Jan 18 16:42:09.258012 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 563/1118] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:42:09 2022] GET /compute/v2.1/servers/6622da12-a0e7-4ddc-b0eb-cdc5098937fb => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:42:10.273877 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-cf4d9444-ade1-47cc-b862-49d8570773cb tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:42:10.274492 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-cf4d9444-ade1-47cc-b862-49d8570773cb tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: 6622da12-a0e7-4ddc-b0eb-cdc5098937fb] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:42:10.280891 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-cf4d9444-ade1-47cc-b862-49d8570773cb tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:10.281370 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-cf4d9444-ade1-47cc-b862-49d8570773cb tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:10.282149 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-cf4d9444-ade1-47cc-b862-49d8570773cb tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:10.282584 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-cf4d9444-ade1-47cc-b862-49d8570773cb tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:10.410547 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-cf4d9444-ade1-47cc-b862-49d8570773cb tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f30f1ddb7249b5a7551464a7ab48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cee5b17bce4fc186700e306378f767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:42:10.417849 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-cf4d9444-ade1-47cc-b862-49d8570773cb tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "GET /compute/v2.1/servers/6622da12-a0e7-4ddc-b0eb-cdc5098937fb" status: 200 len: 1317 microversion: 2.1 time: 0.147734 Jan 18 16:42:10.418399 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 556/1119] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:42:10 2022] GET /compute/v2.1/servers/6622da12-a0e7-4ddc-b0eb-cdc5098937fb => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:42:11.348394 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [req-f92a946f-2a9f-431e-8ea9-f77c39f258ee req-3fff2b91-b9e7-4944-97d6-1c1dba5a9f77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6622da12-a0e7-4ddc-b0eb-cdc5098937fb", "name": "network-vif-plugged", "status": "completed", "tag": "4e43b3a1-3e71-4876-b998-a471d3058d1f"}]} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:42:11.350177 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:42:11.350177 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: warnings.warn(msg) Jan 18 16:42:11.357975 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-f92a946f-2a9f-431e-8ea9-f77c39f258ee req-3fff2b91-b9e7-4944-97d6-1c1dba5a9f77 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:11.358448 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-f92a946f-2a9f-431e-8ea9-f77c39f258ee req-3fff2b91-b9e7-4944-97d6-1c1dba5a9f77 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:11.369403 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.compute.server_external_events [req-f92a946f-2a9f-431e-8ea9-f77c39f258ee req-3fff2b91-b9e7-4944-97d6-1c1dba5a9f77 service nova] Creating event network-vif-plugged:4e43b3a1-3e71-4876-b998-a471d3058d1f for instance 6622da12-a0e7-4ddc-b0eb-cdc5098937fb on hv-cinder-78836 Jan 18 16:42:11.374264 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [req-f92a946f-2a9f-431e-8ea9-f77c39f258ee req-3fff2b91-b9e7-4944-97d6-1c1dba5a9f77 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029702 Jan 18 16:42:11.374879 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 564/1120] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:42:11.435261 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-3045b2fb-784a-462a-9d7d-df6ae72dd213 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:42:11.436436 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-3045b2fb-784a-462a-9d7d-df6ae72dd213 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: 6622da12-a0e7-4ddc-b0eb-cdc5098937fb] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:42:11.443503 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3045b2fb-784a-462a-9d7d-df6ae72dd213 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:11.443957 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3045b2fb-784a-462a-9d7d-df6ae72dd213 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:11.444745 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3045b2fb-784a-462a-9d7d-df6ae72dd213 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:11.445210 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3045b2fb-784a-462a-9d7d-df6ae72dd213 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:11.634418 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-3045b2fb-784a-462a-9d7d-df6ae72dd213 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f30f1ddb7249b5a7551464a7ab48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cee5b17bce4fc186700e306378f767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:42:11.641672 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-3045b2fb-784a-462a-9d7d-df6ae72dd213 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "GET /compute/v2.1/servers/6622da12-a0e7-4ddc-b0eb-cdc5098937fb" status: 200 len: 1317 microversion: 2.1 time: 0.210168 Jan 18 16:42:11.642236 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 557/1121] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:42:11 2022] GET /compute/v2.1/servers/6622da12-a0e7-4ddc-b0eb-cdc5098937fb => generated 1317 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:42:12.659986 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-6b8bc6b8-1597-4b9e-94b0-93b35fd3ab13 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:42:12.660600 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-6b8bc6b8-1597-4b9e-94b0-93b35fd3ab13 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: 6622da12-a0e7-4ddc-b0eb-cdc5098937fb] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:42:12.667257 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6b8bc6b8-1597-4b9e-94b0-93b35fd3ab13 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:12.667703 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6b8bc6b8-1597-4b9e-94b0-93b35fd3ab13 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:12.668478 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6b8bc6b8-1597-4b9e-94b0-93b35fd3ab13 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:12.668935 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6b8bc6b8-1597-4b9e-94b0-93b35fd3ab13 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:12.801464 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-6b8bc6b8-1597-4b9e-94b0-93b35fd3ab13 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f30f1ddb7249b5a7551464a7ab48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cee5b17bce4fc186700e306378f767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:42:12.808637 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-6b8bc6b8-1597-4b9e-94b0-93b35fd3ab13 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "GET /compute/v2.1/servers/6622da12-a0e7-4ddc-b0eb-cdc5098937fb" status: 200 len: 1317 microversion: 2.1 time: 0.153205 Jan 18 16:42:12.809250 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 565/1122] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:42:12 2022] GET /compute/v2.1/servers/6622da12-a0e7-4ddc-b0eb-cdc5098937fb => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:42:13.825621 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-4dd7067d-b535-4858-81d2-890d51662978 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:42:13.826223 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-4dd7067d-b535-4858-81d2-890d51662978 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: 6622da12-a0e7-4ddc-b0eb-cdc5098937fb] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:42:13.832563 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4dd7067d-b535-4858-81d2-890d51662978 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:13.833063 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4dd7067d-b535-4858-81d2-890d51662978 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:13.834513 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4dd7067d-b535-4858-81d2-890d51662978 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:13.835240 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4dd7067d-b535-4858-81d2-890d51662978 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:13.985948 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-4dd7067d-b535-4858-81d2-890d51662978 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f30f1ddb7249b5a7551464a7ab48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cee5b17bce4fc186700e306378f767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:42:13.993926 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-4dd7067d-b535-4858-81d2-890d51662978 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "GET /compute/v2.1/servers/6622da12-a0e7-4ddc-b0eb-cdc5098937fb" status: 200 len: 1507 microversion: 2.1 time: 0.171721 Jan 18 16:42:13.994586 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 558/1123] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:42:13 2022] GET /compute/v2.1/servers/6622da12-a0e7-4ddc-b0eb-cdc5098937fb => generated 1507 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:42:14.012664 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-96c14176-292a-4357-841e-2c6b85330ab7 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52f0729d-82ec-4a4b-a4e5-4ae9e6e5a90d"}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:42:14.013753 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-96c14176-292a-4357-841e-2c6b85330ab7 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: 6622da12-a0e7-4ddc-b0eb-cdc5098937fb] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:42:14.020294 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-96c14176-292a-4357-841e-2c6b85330ab7 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:14.021769 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-96c14176-292a-4357-841e-2c6b85330ab7 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:14.022303 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-96c14176-292a-4357-841e-2c6b85330ab7 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:14.022746 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-96c14176-292a-4357-841e-2c6b85330ab7 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:14.098270 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.wsgi [None req-96c14176-292a-4357-841e-2c6b85330ab7 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] HTTP exception thrown: Invalid volume: volume 52f0729d-82ec-4a4b-a4e5-4ae9e6e5a90d is already attached to instances: c9d430db-b5ab-4c0e-add0-a4abe3607e9c Jan 18 16:42:14.099512 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-96c14176-292a-4357-841e-2c6b85330ab7 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Returning 400 to user: Invalid volume: volume 52f0729d-82ec-4a4b-a4e5-4ae9e6e5a90d is already attached to instances: c9d430db-b5ab-4c0e-add0-a4abe3607e9c {{(pid=116367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 16:42:14.100434 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-96c14176-292a-4357-841e-2c6b85330ab7 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "POST /compute/v2.1/servers/6622da12-a0e7-4ddc-b0eb-cdc5098937fb/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.091705 Jan 18 16:42:14.101005 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 566/1124] 10.222.0.82 () {60 vars in 1322 bytes} [Tue Jan 18 16:42:14 2022] POST /compute/v2.1/servers/6622da12-a0e7-4ddc-b0eb-cdc5098937fb/os-volume_attachments => generated 174 bytes in 93 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 18 16:42:14.156933 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-aff76ab6-51f1-43f6-a441-4cd439a796f9 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:42:14.157462 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-aff76ab6-51f1-43f6-a441-4cd439a796f9 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: c9d430db-b5ab-4c0e-add0-a4abe3607e9c] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:42:14.163811 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-aff76ab6-51f1-43f6-a441-4cd439a796f9 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:14.164336 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-aff76ab6-51f1-43f6-a441-4cd439a796f9 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:14.165198 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-aff76ab6-51f1-43f6-a441-4cd439a796f9 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:14.165641 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-aff76ab6-51f1-43f6-a441-4cd439a796f9 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:14.241563 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.objects.instance [None req-aff76ab6-51f1-43f6-a441-4cd439a796f9 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lazy-loading 'services' on Instance uuid c9d430db-b5ab-4c0e-add0-a4abe3607e9c {{(pid=116368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 18 16:42:14.318383 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-aff76ab6-51f1-43f6-a441-4cd439a796f9 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "DELETE /compute/v2.1/servers/c9d430db-b5ab-4c0e-add0-a4abe3607e9c/os-volume_attachments/52f0729d-82ec-4a4b-a4e5-4ae9e6e5a90d" status: 202 len: 0 microversion: 2.1 time: 0.165032 Jan 18 16:42:14.319026 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 559/1125] 10.222.0.82 () {58 vars in 1415 bytes} [Tue Jan 18 16:42:14 2022] DELETE /compute/v2.1/servers/c9d430db-b5ab-4c0e-add0-a4abe3607e9c/os-volume_attachments/52f0729d-82ec-4a4b-a4e5-4ae9e6e5a90d => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:42:14.327037 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-5ebd25a1-f35c-4325-af17-34fdb6857b58 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:42:14.327975 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-5ebd25a1-f35c-4325-af17-34fdb6857b58 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: c9d430db-b5ab-4c0e-add0-a4abe3607e9c] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:42:14.334890 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-5ebd25a1-f35c-4325-af17-34fdb6857b58 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:14.335283 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-5ebd25a1-f35c-4325-af17-34fdb6857b58 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:14.336135 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-5ebd25a1-f35c-4325-af17-34fdb6857b58 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:14.336558 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-5ebd25a1-f35c-4325-af17-34fdb6857b58 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:14.367671 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-5ebd25a1-f35c-4325-af17-34fdb6857b58 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "GET /compute/v2.1/servers/c9d430db-b5ab-4c0e-add0-a4abe3607e9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044273 Jan 18 16:42:14.368238 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 567/1126] 10.222.0.82 () {58 vars in 1301 bytes} [Tue Jan 18 16:42:14 2022] GET /compute/v2.1/servers/c9d430db-b5ab-4c0e-add0-a4abe3607e9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:42:15.380806 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-8281881a-9391-4a3a-b66f-6042f6c0ae91 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:42:15.381861 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-8281881a-9391-4a3a-b66f-6042f6c0ae91 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: c9d430db-b5ab-4c0e-add0-a4abe3607e9c] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:42:15.387934 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8281881a-9391-4a3a-b66f-6042f6c0ae91 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:15.388376 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8281881a-9391-4a3a-b66f-6042f6c0ae91 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:15.389182 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8281881a-9391-4a3a-b66f-6042f6c0ae91 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:15.389613 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-8281881a-9391-4a3a-b66f-6042f6c0ae91 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:15.418806 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-8281881a-9391-4a3a-b66f-6042f6c0ae91 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "GET /compute/v2.1/servers/c9d430db-b5ab-4c0e-add0-a4abe3607e9c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043273 Jan 18 16:42:15.419355 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 560/1127] 10.222.0.82 () {58 vars in 1301 bytes} [Tue Jan 18 16:42:15 2022] GET /compute/v2.1/servers/c9d430db-b5ab-4c0e-add0-a4abe3607e9c/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 18 16:42:15.518168 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-04d418a5-5b58-41a0-b9a2-9a181d81471a tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1104401090", "imageRef": "900c4a9d-b6c6-451f-a509-eb4f4b49f459", "flavorRef": "452", "networks": [{"uuid": "3b3b985b-c3d6-45d3-ad06-0901ba978884"}]}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:42:15.569327 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.network.neutron [None req-04d418a5-5b58-41a0-b9a2-9a181d81471a tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] validate_networks() for [('3b3b985b-c3d6-45d3-ad06-0901ba978884', None, None, None, None, None)] {{(pid=116367) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 18 16:42:15.924203 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.virt.hardware [None req-04d418a5-5b58-41a0-b9a2-9a181d81471a tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Flavor limits 0:0:0 {{(pid=116367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 18 16:42:15.924628 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.virt.hardware [None req-04d418a5-5b58-41a0-b9a2-9a181d81471a tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Image limits 0:0:0 {{(pid=116367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 18 16:42:15.925211 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.virt.hardware [None req-04d418a5-5b58-41a0-b9a2-9a181d81471a tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Flavor pref 0:0:0 {{(pid=116367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 18 16:42:15.925645 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.virt.hardware [None req-04d418a5-5b58-41a0-b9a2-9a181d81471a tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Image pref 0:0:0 {{(pid=116367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 18 16:42:15.926062 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.virt.hardware [None req-04d418a5-5b58-41a0-b9a2-9a181d81471a tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 18 16:42:15.935965 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-04d418a5-5b58-41a0-b9a2-9a181d81471a tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:15.936414 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-04d418a5-5b58-41a0-b9a2-9a181d81471a tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:15.937265 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-04d418a5-5b58-41a0-b9a2-9a181d81471a tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:15.937703 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-04d418a5-5b58-41a0-b9a2-9a181d81471a tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:15.959963 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.quota [None req-04d418a5-5b58-41a0-b9a2-9a181d81471a tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Getting quotas for project 83cee5b17bce4fc186700e306378f767. Resources: {'ram', 'instances', 'cores'} {{(pid=116367) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 16:42:15.964055 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.quota [None req-04d418a5-5b58-41a0-b9a2-9a181d81471a tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Getting quotas for user e1f30f1ddb7249b5a7551464a7ab48fc and project 83cee5b17bce4fc186700e306378f767. Resources: {'ram', 'instances', 'cores'} {{(pid=116367) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 16:42:15.975749 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-04d418a5-5b58-41a0-b9a2-9a181d81471a tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Going to run 1 instances... {{(pid=116367) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 18 16:42:15.978088 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-04d418a5-5b58-41a0-b9a2-9a181d81471a tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: eb69959b-1cc0-4168-aee6-0886926fba95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='900c4a9d-b6c6-451f-a509-eb4f4b49f459',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 18 16:42:16.027464 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-04d418a5-5b58-41a0-b9a2-9a181d81471a tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.513028 Jan 18 16:42:16.028304 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 568/1128] 10.222.0.82 () {60 vars in 1146 bytes} [Tue Jan 18 16:42:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 18 16:42:16.038118 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-57f667d8-5cf5-46be-9fc9-5b9846f5ed20 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:42:16.038729 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-57f667d8-5cf5-46be-9fc9-5b9846f5ed20 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: eb69959b-1cc0-4168-aee6-0886926fba95] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:42:16.089546 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-57f667d8-5cf5-46be-9fc9-5b9846f5ed20 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f30f1ddb7249b5a7551464a7ab48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cee5b17bce4fc186700e306378f767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:42:16.096041 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-57f667d8-5cf5-46be-9fc9-5b9846f5ed20 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "GET /compute/v2.1/servers/eb69959b-1cc0-4168-aee6-0886926fba95" status: 200 len: 1218 microversion: 2.1 time: 0.062091 Jan 18 16:42:16.096640 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 561/1129] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:42:16 2022] GET /compute/v2.1/servers/eb69959b-1cc0-4168-aee6-0886926fba95 => generated 1218 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:42:17.113483 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-0fd20a6a-bdd1-40cb-99d7-45d7e7f73220 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:42:17.114088 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-0fd20a6a-bdd1-40cb-99d7-45d7e7f73220 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: eb69959b-1cc0-4168-aee6-0886926fba95] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:42:17.122824 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0fd20a6a-bdd1-40cb-99d7-45d7e7f73220 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:17.123276 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0fd20a6a-bdd1-40cb-99d7-45d7e7f73220 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:17.124059 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0fd20a6a-bdd1-40cb-99d7-45d7e7f73220 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:17.124497 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0fd20a6a-bdd1-40cb-99d7-45d7e7f73220 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:17.192963 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-0fd20a6a-bdd1-40cb-99d7-45d7e7f73220 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f30f1ddb7249b5a7551464a7ab48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cee5b17bce4fc186700e306378f767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:42:17.200135 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-0fd20a6a-bdd1-40cb-99d7-45d7e7f73220 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "GET /compute/v2.1/servers/eb69959b-1cc0-4168-aee6-0886926fba95" status: 200 len: 1276 microversion: 2.1 time: 0.090825 Jan 18 16:42:17.200699 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 569/1130] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:42:17 2022] GET /compute/v2.1/servers/eb69959b-1cc0-4168-aee6-0886926fba95 => generated 1276 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:42:18.202590 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [req-f8c98272-3f0a-4fd9-a5f8-077175f42319 req-aed9410e-b3da-41bb-93da-db1891207a6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb69959b-1cc0-4168-aee6-0886926fba95", "tag": "56024420-ad6b-4854-aa0f-aa6969a73f3b"}]} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:42:18.204182 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:42:18.204182 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: warnings.warn(msg) Jan 18 16:42:18.215293 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-f8c98272-3f0a-4fd9-a5f8-077175f42319 req-aed9410e-b3da-41bb-93da-db1891207a6a service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:18.215751 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-f8c98272-3f0a-4fd9-a5f8-077175f42319 req-aed9410e-b3da-41bb-93da-db1891207a6a service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:18.216195 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-adf5a58d-635c-4f88-a771-f17b3f1a677e tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:42:18.217738 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-adf5a58d-635c-4f88-a771-f17b3f1a677e tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: eb69959b-1cc0-4168-aee6-0886926fba95] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:42:18.224724 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-adf5a58d-635c-4f88-a771-f17b3f1a677e tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:18.225219 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-adf5a58d-635c-4f88-a771-f17b3f1a677e tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:18.226072 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-adf5a58d-635c-4f88-a771-f17b3f1a677e tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:18.226457 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-adf5a58d-635c-4f88-a771-f17b3f1a677e tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:18.228729 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.compute.server_external_events [req-f8c98272-3f0a-4fd9-a5f8-077175f42319 req-aed9410e-b3da-41bb-93da-db1891207a6a service nova] Creating event network-changed:56024420-ad6b-4854-aa0f-aa6969a73f3b for instance eb69959b-1cc0-4168-aee6-0886926fba95 on hv-cinder-78836 Jan 18 16:42:18.237107 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [req-f8c98272-3f0a-4fd9-a5f8-077175f42319 req-aed9410e-b3da-41bb-93da-db1891207a6a service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037174 Jan 18 16:42:18.237107 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 562/1131] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:42:18.469978 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-adf5a58d-635c-4f88-a771-f17b3f1a677e tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f30f1ddb7249b5a7551464a7ab48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cee5b17bce4fc186700e306378f767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:42:18.477362 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-adf5a58d-635c-4f88-a771-f17b3f1a677e tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "GET /compute/v2.1/servers/eb69959b-1cc0-4168-aee6-0886926fba95" status: 200 len: 1318 microversion: 2.1 time: 0.264888 Jan 18 16:42:18.478020 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 570/1132] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:42:18 2022] GET /compute/v2.1/servers/eb69959b-1cc0-4168-aee6-0886926fba95 => generated 1318 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:42:19.495402 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-2a1ca659-021a-4e61-946a-ff168a4b4464 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:42:19.496104 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-2a1ca659-021a-4e61-946a-ff168a4b4464 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: eb69959b-1cc0-4168-aee6-0886926fba95] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:42:19.502549 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-2a1ca659-021a-4e61-946a-ff168a4b4464 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:19.502997 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-2a1ca659-021a-4e61-946a-ff168a4b4464 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:19.503775 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-2a1ca659-021a-4e61-946a-ff168a4b4464 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:19.504208 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-2a1ca659-021a-4e61-946a-ff168a4b4464 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:19.638340 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-2a1ca659-021a-4e61-946a-ff168a4b4464 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f30f1ddb7249b5a7551464a7ab48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cee5b17bce4fc186700e306378f767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:42:19.646189 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-2a1ca659-021a-4e61-946a-ff168a4b4464 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "GET /compute/v2.1/servers/eb69959b-1cc0-4168-aee6-0886926fba95" status: 200 len: 1318 microversion: 2.1 time: 0.154188 Jan 18 16:42:19.646749 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 563/1133] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:42:19 2022] GET /compute/v2.1/servers/eb69959b-1cc0-4168-aee6-0886926fba95 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:42:20.662722 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-4290fad9-4b3d-4457-a60c-5ed53f5682a0 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:42:20.663277 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-4290fad9-4b3d-4457-a60c-5ed53f5682a0 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: eb69959b-1cc0-4168-aee6-0886926fba95] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:42:20.669435 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4290fad9-4b3d-4457-a60c-5ed53f5682a0 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:20.669872 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4290fad9-4b3d-4457-a60c-5ed53f5682a0 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:20.670637 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4290fad9-4b3d-4457-a60c-5ed53f5682a0 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:20.671065 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4290fad9-4b3d-4457-a60c-5ed53f5682a0 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:20.798260 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-4290fad9-4b3d-4457-a60c-5ed53f5682a0 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f30f1ddb7249b5a7551464a7ab48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cee5b17bce4fc186700e306378f767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:42:20.805943 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-4290fad9-4b3d-4457-a60c-5ed53f5682a0 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "GET /compute/v2.1/servers/eb69959b-1cc0-4168-aee6-0886926fba95" status: 200 len: 1318 microversion: 2.1 time: 0.147056 Jan 18 16:42:20.806510 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 571/1134] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:42:20 2022] GET /compute/v2.1/servers/eb69959b-1cc0-4168-aee6-0886926fba95 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:42:21.823523 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-1052acbe-aa6a-4866-a041-9a09183aef2c tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:42:21.824116 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-1052acbe-aa6a-4866-a041-9a09183aef2c tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: eb69959b-1cc0-4168-aee6-0886926fba95] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:42:21.830348 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1052acbe-aa6a-4866-a041-9a09183aef2c tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:21.830795 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1052acbe-aa6a-4866-a041-9a09183aef2c tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:21.831566 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1052acbe-aa6a-4866-a041-9a09183aef2c tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:21.831993 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1052acbe-aa6a-4866-a041-9a09183aef2c tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:21.961557 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-1052acbe-aa6a-4866-a041-9a09183aef2c tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f30f1ddb7249b5a7551464a7ab48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cee5b17bce4fc186700e306378f767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:42:21.968710 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-1052acbe-aa6a-4866-a041-9a09183aef2c tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "GET /compute/v2.1/servers/eb69959b-1cc0-4168-aee6-0886926fba95" status: 200 len: 1318 microversion: 2.1 time: 0.149924 Jan 18 16:42:21.969311 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 564/1135] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:42:21 2022] GET /compute/v2.1/servers/eb69959b-1cc0-4168-aee6-0886926fba95 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:42:22.985009 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-c46a7f3e-f3e1-492d-877a-b47ef7cbe77b tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:42:22.985625 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-c46a7f3e-f3e1-492d-877a-b47ef7cbe77b tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: eb69959b-1cc0-4168-aee6-0886926fba95] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:42:22.991975 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c46a7f3e-f3e1-492d-877a-b47ef7cbe77b tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:22.992423 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c46a7f3e-f3e1-492d-877a-b47ef7cbe77b tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:22.993229 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c46a7f3e-f3e1-492d-877a-b47ef7cbe77b tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:22.993664 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-c46a7f3e-f3e1-492d-877a-b47ef7cbe77b tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:23.399493 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-c46a7f3e-f3e1-492d-877a-b47ef7cbe77b tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f30f1ddb7249b5a7551464a7ab48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cee5b17bce4fc186700e306378f767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:42:23.407121 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-c46a7f3e-f3e1-492d-877a-b47ef7cbe77b tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "GET /compute/v2.1/servers/eb69959b-1cc0-4168-aee6-0886926fba95" status: 200 len: 1318 microversion: 2.1 time: 0.425797 Jan 18 16:42:23.407701 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 572/1136] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:42:22 2022] GET /compute/v2.1/servers/eb69959b-1cc0-4168-aee6-0886926fba95 => generated 1318 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:42:23.443126 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [req-d5682640-d98c-423e-9f93-5cf51e2327cf req-ea7686b8-a9f3-4118-9409-b2667b5dad7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb69959b-1cc0-4168-aee6-0886926fba95", "name": "network-vif-plugged", "status": "completed", "tag": "56024420-ad6b-4854-aa0f-aa6969a73f3b"}]} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:42:23.445349 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:42:23.445349 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: warnings.warn(msg) Jan 18 16:42:23.459938 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-d5682640-d98c-423e-9f93-5cf51e2327cf req-ea7686b8-a9f3-4118-9409-b2667b5dad7a service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:23.460380 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-d5682640-d98c-423e-9f93-5cf51e2327cf req-ea7686b8-a9f3-4118-9409-b2667b5dad7a service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:23.471292 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.compute.server_external_events [req-d5682640-d98c-423e-9f93-5cf51e2327cf req-ea7686b8-a9f3-4118-9409-b2667b5dad7a service nova] Creating event network-vif-plugged:56024420-ad6b-4854-aa0f-aa6969a73f3b for instance eb69959b-1cc0-4168-aee6-0886926fba95 on hv-cinder-78836 Jan 18 16:42:23.476115 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [req-d5682640-d98c-423e-9f93-5cf51e2327cf req-ea7686b8-a9f3-4118-9409-b2667b5dad7a service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036857 Jan 18 16:42:23.476722 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 565/1137] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:42:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:42:24.423309 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-4ef212a0-5ebc-4ae2-bc54-ea03fa92fc31 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:42:24.423917 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-4ef212a0-5ebc-4ae2-bc54-ea03fa92fc31 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: eb69959b-1cc0-4168-aee6-0886926fba95] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:42:24.430939 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4ef212a0-5ebc-4ae2-bc54-ea03fa92fc31 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:24.431378 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4ef212a0-5ebc-4ae2-bc54-ea03fa92fc31 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:24.432146 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4ef212a0-5ebc-4ae2-bc54-ea03fa92fc31 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:24.432573 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4ef212a0-5ebc-4ae2-bc54-ea03fa92fc31 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:24.562389 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-4ef212a0-5ebc-4ae2-bc54-ea03fa92fc31 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f30f1ddb7249b5a7551464a7ab48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cee5b17bce4fc186700e306378f767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:42:24.570622 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-4ef212a0-5ebc-4ae2-bc54-ea03fa92fc31 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "GET /compute/v2.1/servers/eb69959b-1cc0-4168-aee6-0886926fba95" status: 200 len: 1318 microversion: 2.1 time: 0.150935 Jan 18 16:42:24.571214 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 573/1138] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:42:24 2022] GET /compute/v2.1/servers/eb69959b-1cc0-4168-aee6-0886926fba95 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:42:25.588968 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-c97e5448-b081-4534-97bb-d866cc8db413 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:42:25.589592 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-c97e5448-b081-4534-97bb-d866cc8db413 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: eb69959b-1cc0-4168-aee6-0886926fba95] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:42:25.595603 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c97e5448-b081-4534-97bb-d866cc8db413 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:25.596053 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c97e5448-b081-4534-97bb-d866cc8db413 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:25.596833 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c97e5448-b081-4534-97bb-d866cc8db413 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:25.597297 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-c97e5448-b081-4534-97bb-d866cc8db413 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:25.726642 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-c97e5448-b081-4534-97bb-d866cc8db413 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f30f1ddb7249b5a7551464a7ab48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cee5b17bce4fc186700e306378f767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:42:25.734019 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-c97e5448-b081-4534-97bb-d866cc8db413 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "GET /compute/v2.1/servers/eb69959b-1cc0-4168-aee6-0886926fba95" status: 200 len: 1507 microversion: 2.1 time: 0.150249 Jan 18 16:42:25.734589 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 566/1139] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:42:25 2022] GET /compute/v2.1/servers/eb69959b-1cc0-4168-aee6-0886926fba95 => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:42:27.034840 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-30e8ece6-9182-4139-a3c7-34e05b37b8b4 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c739110-c18b-4038-8998-d8aab661af98"}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:42:27.035974 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-30e8ece6-9182-4139-a3c7-34e05b37b8b4 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: eb69959b-1cc0-4168-aee6-0886926fba95] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:42:27.042503 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-30e8ece6-9182-4139-a3c7-34e05b37b8b4 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:27.042944 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-30e8ece6-9182-4139-a3c7-34e05b37b8b4 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:27.043709 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-30e8ece6-9182-4139-a3c7-34e05b37b8b4 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:27.044135 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-30e8ece6-9182-4139-a3c7-34e05b37b8b4 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:27.292191 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-30e8ece6-9182-4139-a3c7-34e05b37b8b4 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "POST /compute/v2.1/servers/eb69959b-1cc0-4168-aee6-0886926fba95/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260950 Jan 18 16:42:27.292786 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 574/1140] 10.222.0.82 () {60 vars in 1322 bytes} [Tue Jan 18 16:42:27 2022] POST /compute/v2.1/servers/eb69959b-1cc0-4168-aee6-0886926fba95/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:42:33.707203 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-3d2f9a9c-6b3a-4f0e-9e70-fd1a1bbf5fd2 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c739110-c18b-4038-8998-d8aab661af98"}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:42:33.708288 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-3d2f9a9c-6b3a-4f0e-9e70-fd1a1bbf5fd2 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: eb69959b-1cc0-4168-aee6-0886926fba95] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:42:33.714582 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3d2f9a9c-6b3a-4f0e-9e70-fd1a1bbf5fd2 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:33.715031 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3d2f9a9c-6b3a-4f0e-9e70-fd1a1bbf5fd2 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:33.715845 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3d2f9a9c-6b3a-4f0e-9e70-fd1a1bbf5fd2 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:33.716280 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3d2f9a9c-6b3a-4f0e-9e70-fd1a1bbf5fd2 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:33.791897 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.wsgi [None req-3d2f9a9c-6b3a-4f0e-9e70-fd1a1bbf5fd2 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] HTTP exception thrown: Invalid volume: volume 9c739110-c18b-4038-8998-d8aab661af98 is already attached to instances: eb69959b-1cc0-4168-aee6-0886926fba95 Jan 18 16:42:33.792582 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-3d2f9a9c-6b3a-4f0e-9e70-fd1a1bbf5fd2 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Returning 400 to user: Invalid volume: volume 9c739110-c18b-4038-8998-d8aab661af98 is already attached to instances: eb69959b-1cc0-4168-aee6-0886926fba95 {{(pid=116368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 16:42:33.793486 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-3d2f9a9c-6b3a-4f0e-9e70-fd1a1bbf5fd2 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "POST /compute/v2.1/servers/eb69959b-1cc0-4168-aee6-0886926fba95/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.090168 Jan 18 16:42:33.794216 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 567/1141] 10.222.0.82 () {60 vars in 1322 bytes} [Tue Jan 18 16:42:33 2022] POST /compute/v2.1/servers/eb69959b-1cc0-4168-aee6-0886926fba95/os-volume_attachments => generated 174 bytes in 91 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 18 16:42:33.852516 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-f1741362-326b-4ae3-bfeb-d8b6e663027f tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:42:33.853127 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-f1741362-326b-4ae3-bfeb-d8b6e663027f tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: eb69959b-1cc0-4168-aee6-0886926fba95] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:42:33.859523 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-f1741362-326b-4ae3-bfeb-d8b6e663027f tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:33.859962 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-f1741362-326b-4ae3-bfeb-d8b6e663027f tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:33.860726 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-f1741362-326b-4ae3-bfeb-d8b6e663027f tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:33.861192 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-f1741362-326b-4ae3-bfeb-d8b6e663027f tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:33.938504 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.objects.instance [None req-f1741362-326b-4ae3-bfeb-d8b6e663027f tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lazy-loading 'services' on Instance uuid eb69959b-1cc0-4168-aee6-0886926fba95 {{(pid=116367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 18 16:42:34.009422 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-f1741362-326b-4ae3-bfeb-d8b6e663027f tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "DELETE /compute/v2.1/servers/eb69959b-1cc0-4168-aee6-0886926fba95/os-volume_attachments/9c739110-c18b-4038-8998-d8aab661af98" status: 202 len: 0 microversion: 2.1 time: 0.161227 Jan 18 16:42:34.009935 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 575/1142] 10.222.0.82 () {58 vars in 1415 bytes} [Tue Jan 18 16:42:33 2022] DELETE /compute/v2.1/servers/eb69959b-1cc0-4168-aee6-0886926fba95/os-volume_attachments/9c739110-c18b-4038-8998-d8aab661af98 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:42:34.018030 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-1947af3c-39e9-431c-8205-b612fe10e23d tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:42:34.018943 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-1947af3c-39e9-431c-8205-b612fe10e23d tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: eb69959b-1cc0-4168-aee6-0886926fba95] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:42:34.025990 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1947af3c-39e9-431c-8205-b612fe10e23d tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:34.026484 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1947af3c-39e9-431c-8205-b612fe10e23d tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:34.027369 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1947af3c-39e9-431c-8205-b612fe10e23d tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:34.027894 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1947af3c-39e9-431c-8205-b612fe10e23d tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:34.060002 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-1947af3c-39e9-431c-8205-b612fe10e23d tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "GET /compute/v2.1/servers/eb69959b-1cc0-4168-aee6-0886926fba95/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045682 Jan 18 16:42:34.060576 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 568/1143] 10.222.0.82 () {58 vars in 1301 bytes} [Tue Jan 18 16:42:34 2022] GET /compute/v2.1/servers/eb69959b-1cc0-4168-aee6-0886926fba95/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:42:35.073398 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-54b02917-e8b2-441c-9d6b-0b3434045fb8 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:42:35.074323 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-54b02917-e8b2-441c-9d6b-0b3434045fb8 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: eb69959b-1cc0-4168-aee6-0886926fba95] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:42:35.080840 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-54b02917-e8b2-441c-9d6b-0b3434045fb8 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:35.081333 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-54b02917-e8b2-441c-9d6b-0b3434045fb8 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:35.082107 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-54b02917-e8b2-441c-9d6b-0b3434045fb8 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:35.082540 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-54b02917-e8b2-441c-9d6b-0b3434045fb8 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:35.110760 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-54b02917-e8b2-441c-9d6b-0b3434045fb8 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "GET /compute/v2.1/servers/eb69959b-1cc0-4168-aee6-0886926fba95/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042747 Jan 18 16:42:35.111304 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 576/1144] 10.222.0.82 () {58 vars in 1301 bytes} [Tue Jan 18 16:42:35 2022] GET /compute/v2.1/servers/eb69959b-1cc0-4168-aee6-0886926fba95/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 18 16:42:35.205981 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-a7570586-8b14-4164-9066-826922748161 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2005583927", "imageRef": "900c4a9d-b6c6-451f-a509-eb4f4b49f459", "flavorRef": "452", "networks": [{"uuid": "3b3b985b-c3d6-45d3-ad06-0901ba978884"}]}} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:42:35.256469 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.network.neutron [None req-a7570586-8b14-4164-9066-826922748161 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] validate_networks() for [('3b3b985b-c3d6-45d3-ad06-0901ba978884', None, None, None, None, None)] {{(pid=116368) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 18 16:42:35.611540 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-a7570586-8b14-4164-9066-826922748161 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Flavor limits 0:0:0 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 18 16:42:35.611964 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-a7570586-8b14-4164-9066-826922748161 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Image limits 0:0:0 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 18 16:42:35.612495 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-a7570586-8b14-4164-9066-826922748161 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Flavor pref 0:0:0 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 18 16:42:35.612851 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-a7570586-8b14-4164-9066-826922748161 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Image pref 0:0:0 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 18 16:42:35.613288 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.virt.hardware [None req-a7570586-8b14-4164-9066-826922748161 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 18 16:42:35.622016 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a7570586-8b14-4164-9066-826922748161 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:35.622438 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a7570586-8b14-4164-9066-826922748161 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:35.623250 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a7570586-8b14-4164-9066-826922748161 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:35.623684 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-a7570586-8b14-4164-9066-826922748161 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:35.639756 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.quota [None req-a7570586-8b14-4164-9066-826922748161 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Getting quotas for project 83cee5b17bce4fc186700e306378f767. Resources: {'ram', 'instances', 'cores'} {{(pid=116368) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 16:42:35.643614 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.quota [None req-a7570586-8b14-4164-9066-826922748161 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Getting quotas for user e1f30f1ddb7249b5a7551464a7ab48fc and project 83cee5b17bce4fc186700e306378f767. Resources: {'ram', 'instances', 'cores'} {{(pid=116368) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 16:42:35.655688 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-a7570586-8b14-4164-9066-826922748161 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Going to run 1 instances... {{(pid=116368) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 18 16:42:35.658077 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-a7570586-8b14-4164-9066-826922748161 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: eefb99f0-e5c6-47e0-8335-009e2b8c5700] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='900c4a9d-b6c6-451f-a509-eb4f4b49f459',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116368) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 18 16:42:35.702017 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-a7570586-8b14-4164-9066-826922748161 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.499653 Jan 18 16:42:35.702654 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 569/1145] 10.222.0.82 () {60 vars in 1146 bytes} [Tue Jan 18 16:42:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 501 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 18 16:42:35.713070 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-88e07ab2-d6a4-4c13-b80f-7e092527e396 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:42:35.713684 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-88e07ab2-d6a4-4c13-b80f-7e092527e396 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: eefb99f0-e5c6-47e0-8335-009e2b8c5700] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:42:35.765138 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-88e07ab2-d6a4-4c13-b80f-7e092527e396 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f30f1ddb7249b5a7551464a7ab48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cee5b17bce4fc186700e306378f767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:42:35.771629 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-88e07ab2-d6a4-4c13-b80f-7e092527e396 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "GET /compute/v2.1/servers/eefb99f0-e5c6-47e0-8335-009e2b8c5700" status: 200 len: 1218 microversion: 2.1 time: 0.062894 Jan 18 16:42:35.772127 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 577/1146] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:42:35 2022] GET /compute/v2.1/servers/eefb99f0-e5c6-47e0-8335-009e2b8c5700 => generated 1218 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:42:36.789160 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-82e03edf-b595-45bb-ae15-6486980bc5d0 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:42:36.789781 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-82e03edf-b595-45bb-ae15-6486980bc5d0 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: eefb99f0-e5c6-47e0-8335-009e2b8c5700] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:42:36.795604 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-82e03edf-b595-45bb-ae15-6486980bc5d0 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:36.796050 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-82e03edf-b595-45bb-ae15-6486980bc5d0 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:36.796829 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-82e03edf-b595-45bb-ae15-6486980bc5d0 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:36.797286 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-82e03edf-b595-45bb-ae15-6486980bc5d0 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:36.860805 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-82e03edf-b595-45bb-ae15-6486980bc5d0 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f30f1ddb7249b5a7551464a7ab48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cee5b17bce4fc186700e306378f767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:42:36.870623 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-82e03edf-b595-45bb-ae15-6486980bc5d0 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "GET /compute/v2.1/servers/eefb99f0-e5c6-47e0-8335-009e2b8c5700" status: 200 len: 1276 microversion: 2.1 time: 0.086039 Jan 18 16:42:36.871250 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 570/1147] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:42:36 2022] GET /compute/v2.1/servers/eefb99f0-e5c6-47e0-8335-009e2b8c5700 => generated 1276 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:42:37.889334 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-b328f732-82a4-43d3-96a1-f3efa662a59d tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:42:37.889887 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-b328f732-82a4-43d3-96a1-f3efa662a59d tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: eefb99f0-e5c6-47e0-8335-009e2b8c5700] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:42:37.897748 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-b328f732-82a4-43d3-96a1-f3efa662a59d tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:37.898240 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-b328f732-82a4-43d3-96a1-f3efa662a59d tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:37.899035 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-b328f732-82a4-43d3-96a1-f3efa662a59d tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:37.899470 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-b328f732-82a4-43d3-96a1-f3efa662a59d tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:37.910866 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [req-b66b1b56-c02f-4017-82ed-f221fa46e783 req-3f38d100-86cc-467f-8cc0-728914bb77a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eefb99f0-e5c6-47e0-8335-009e2b8c5700", "tag": "071e0062-44e2-4ab1-b50f-0e26dabec496"}]} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:42:37.913354 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:42:37.913354 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: warnings.warn(msg) Jan 18 16:42:37.923053 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-b66b1b56-c02f-4017-82ed-f221fa46e783 req-3f38d100-86cc-467f-8cc0-728914bb77a6 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:37.923507 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-b66b1b56-c02f-4017-82ed-f221fa46e783 req-3f38d100-86cc-467f-8cc0-728914bb77a6 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:37.948575 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.compute.server_external_events [req-b66b1b56-c02f-4017-82ed-f221fa46e783 req-3f38d100-86cc-467f-8cc0-728914bb77a6 service nova] Creating event network-changed:071e0062-44e2-4ab1-b50f-0e26dabec496 for instance eefb99f0-e5c6-47e0-8335-009e2b8c5700 on hv-cinder-78836 Jan 18 16:42:37.954183 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [req-b66b1b56-c02f-4017-82ed-f221fa46e783 req-3f38d100-86cc-467f-8cc0-728914bb77a6 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046555 Jan 18 16:42:37.954535 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 571/1148] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:42:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:42:38.133836 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-b328f732-82a4-43d3-96a1-f3efa662a59d tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f30f1ddb7249b5a7551464a7ab48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cee5b17bce4fc186700e306378f767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:42:38.141323 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-b328f732-82a4-43d3-96a1-f3efa662a59d tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "GET /compute/v2.1/servers/eefb99f0-e5c6-47e0-8335-009e2b8c5700" status: 200 len: 1318 microversion: 2.1 time: 0.255654 Jan 18 16:42:38.141823 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 578/1149] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:42:37 2022] GET /compute/v2.1/servers/eefb99f0-e5c6-47e0-8335-009e2b8c5700 => generated 1318 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:42:39.159438 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-2bbd4281-535b-4b53-adb3-764fc1c90a8c tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:42:39.160051 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-2bbd4281-535b-4b53-adb3-764fc1c90a8c tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: eefb99f0-e5c6-47e0-8335-009e2b8c5700] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:42:39.166249 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-2bbd4281-535b-4b53-adb3-764fc1c90a8c tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:39.166699 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-2bbd4281-535b-4b53-adb3-764fc1c90a8c tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:39.167481 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-2bbd4281-535b-4b53-adb3-764fc1c90a8c tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:39.168008 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-2bbd4281-535b-4b53-adb3-764fc1c90a8c tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:39.301710 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-2bbd4281-535b-4b53-adb3-764fc1c90a8c tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f30f1ddb7249b5a7551464a7ab48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cee5b17bce4fc186700e306378f767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:42:39.310396 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-2bbd4281-535b-4b53-adb3-764fc1c90a8c tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "GET /compute/v2.1/servers/eefb99f0-e5c6-47e0-8335-009e2b8c5700" status: 200 len: 1318 microversion: 2.1 time: 0.155510 Jan 18 16:42:39.310957 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 572/1150] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:42:39 2022] GET /compute/v2.1/servers/eefb99f0-e5c6-47e0-8335-009e2b8c5700 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:42:40.327221 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-824ab7a5-abe6-44be-ae6d-fd7137fbb66b tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:42:40.327825 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-824ab7a5-abe6-44be-ae6d-fd7137fbb66b tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: eefb99f0-e5c6-47e0-8335-009e2b8c5700] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:42:40.334154 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-824ab7a5-abe6-44be-ae6d-fd7137fbb66b tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:40.334636 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-824ab7a5-abe6-44be-ae6d-fd7137fbb66b tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:40.335611 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-824ab7a5-abe6-44be-ae6d-fd7137fbb66b tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:40.336067 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-824ab7a5-abe6-44be-ae6d-fd7137fbb66b tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:40.462428 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-824ab7a5-abe6-44be-ae6d-fd7137fbb66b tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f30f1ddb7249b5a7551464a7ab48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cee5b17bce4fc186700e306378f767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:42:40.469513 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-824ab7a5-abe6-44be-ae6d-fd7137fbb66b tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "GET /compute/v2.1/servers/eefb99f0-e5c6-47e0-8335-009e2b8c5700" status: 200 len: 1318 microversion: 2.1 time: 0.145985 Jan 18 16:42:40.470095 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 579/1151] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:42:40 2022] GET /compute/v2.1/servers/eefb99f0-e5c6-47e0-8335-009e2b8c5700 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:42:41.486641 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-d910ca06-9b40-4015-8a2f-a623327bfc5e tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:42:41.487256 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-d910ca06-9b40-4015-8a2f-a623327bfc5e tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: eefb99f0-e5c6-47e0-8335-009e2b8c5700] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:42:41.493771 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d910ca06-9b40-4015-8a2f-a623327bfc5e tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:41.494137 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d910ca06-9b40-4015-8a2f-a623327bfc5e tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:41.494920 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d910ca06-9b40-4015-8a2f-a623327bfc5e tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:41.495355 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-d910ca06-9b40-4015-8a2f-a623327bfc5e tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:41.634312 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-d910ca06-9b40-4015-8a2f-a623327bfc5e tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f30f1ddb7249b5a7551464a7ab48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cee5b17bce4fc186700e306378f767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:42:41.641518 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-d910ca06-9b40-4015-8a2f-a623327bfc5e tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "GET /compute/v2.1/servers/eefb99f0-e5c6-47e0-8335-009e2b8c5700" status: 200 len: 1318 microversion: 2.1 time: 0.158557 Jan 18 16:42:41.642082 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 573/1152] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:42:41 2022] GET /compute/v2.1/servers/eefb99f0-e5c6-47e0-8335-009e2b8c5700 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:42:42.658655 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-2aa39a94-5542-414e-b1a4-b49141ad302d tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:42:42.659227 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-2aa39a94-5542-414e-b1a4-b49141ad302d tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: eefb99f0-e5c6-47e0-8335-009e2b8c5700] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:42:42.666111 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2aa39a94-5542-414e-b1a4-b49141ad302d tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:42.666564 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2aa39a94-5542-414e-b1a4-b49141ad302d tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:42.667339 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2aa39a94-5542-414e-b1a4-b49141ad302d tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:42.667781 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-2aa39a94-5542-414e-b1a4-b49141ad302d tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:42.802851 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-2aa39a94-5542-414e-b1a4-b49141ad302d tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f30f1ddb7249b5a7551464a7ab48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cee5b17bce4fc186700e306378f767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:42:42.810389 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-2aa39a94-5542-414e-b1a4-b49141ad302d tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "GET /compute/v2.1/servers/eefb99f0-e5c6-47e0-8335-009e2b8c5700" status: 200 len: 1318 microversion: 2.1 time: 0.155498 Jan 18 16:42:42.810968 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 580/1153] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:42:42 2022] GET /compute/v2.1/servers/eefb99f0-e5c6-47e0-8335-009e2b8c5700 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:42:43.506466 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [req-fce4409d-0a2f-49e9-b783-651e39003757 req-7a7c0d59-d30a-4baf-98e9-8d12a32873eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eefb99f0-e5c6-47e0-8335-009e2b8c5700", "name": "network-vif-plugged", "status": "completed", "tag": "071e0062-44e2-4ab1-b50f-0e26dabec496"}]} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:42:43.508181 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:42:43.508181 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: warnings.warn(msg) Jan 18 16:42:43.516323 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-fce4409d-0a2f-49e9-b783-651e39003757 req-7a7c0d59-d30a-4baf-98e9-8d12a32873eb service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:43.516859 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-fce4409d-0a2f-49e9-b783-651e39003757 req-7a7c0d59-d30a-4baf-98e9-8d12a32873eb service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:43.528346 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.compute.server_external_events [req-fce4409d-0a2f-49e9-b783-651e39003757 req-7a7c0d59-d30a-4baf-98e9-8d12a32873eb service nova] Creating event network-vif-plugged:071e0062-44e2-4ab1-b50f-0e26dabec496 for instance eefb99f0-e5c6-47e0-8335-009e2b8c5700 on hv-cinder-78836 Jan 18 16:42:43.533113 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [req-fce4409d-0a2f-49e9-b783-651e39003757 req-7a7c0d59-d30a-4baf-98e9-8d12a32873eb service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030404 Jan 18 16:42:43.533867 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 574/1154] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:42:43.827324 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-4f86797f-0921-40be-a171-85d705faa8de tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:42:43.827951 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-4f86797f-0921-40be-a171-85d705faa8de tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: eefb99f0-e5c6-47e0-8335-009e2b8c5700] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:42:43.834122 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4f86797f-0921-40be-a171-85d705faa8de tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:43.834564 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4f86797f-0921-40be-a171-85d705faa8de tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:43.835836 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4f86797f-0921-40be-a171-85d705faa8de tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:43.836260 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-4f86797f-0921-40be-a171-85d705faa8de tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:43.965416 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-4f86797f-0921-40be-a171-85d705faa8de tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f30f1ddb7249b5a7551464a7ab48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cee5b17bce4fc186700e306378f767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:42:43.972572 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-4f86797f-0921-40be-a171-85d705faa8de tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "GET /compute/v2.1/servers/eefb99f0-e5c6-47e0-8335-009e2b8c5700" status: 200 len: 1318 microversion: 2.1 time: 0.148917 Jan 18 16:42:43.973182 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 581/1155] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:42:43 2022] GET /compute/v2.1/servers/eefb99f0-e5c6-47e0-8335-009e2b8c5700 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:42:44.990252 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-3626f199-a522-4235-9d3c-6c520da3819f tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:42:44.990950 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-3626f199-a522-4235-9d3c-6c520da3819f tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: eefb99f0-e5c6-47e0-8335-009e2b8c5700] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:42:44.998178 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3626f199-a522-4235-9d3c-6c520da3819f tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:44.998628 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3626f199-a522-4235-9d3c-6c520da3819f tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:44.999402 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3626f199-a522-4235-9d3c-6c520da3819f tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:44.999837 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3626f199-a522-4235-9d3c-6c520da3819f tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:45.128246 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-3626f199-a522-4235-9d3c-6c520da3819f tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f30f1ddb7249b5a7551464a7ab48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cee5b17bce4fc186700e306378f767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:42:45.136028 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-3626f199-a522-4235-9d3c-6c520da3819f tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "GET /compute/v2.1/servers/eefb99f0-e5c6-47e0-8335-009e2b8c5700" status: 200 len: 1507 microversion: 2.1 time: 0.149800 Jan 18 16:42:45.136756 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 575/1156] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:42:44 2022] GET /compute/v2.1/servers/eefb99f0-e5c6-47e0-8335-009e2b8c5700 => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:42:46.447862 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-a97cd12b-0ce2-452b-b790-59346c43d679 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7c2c5ba3-458b-4e7d-9f86-e639fe6dc10c"}} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:42:46.448964 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-a97cd12b-0ce2-452b-b790-59346c43d679 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: eefb99f0-e5c6-47e0-8335-009e2b8c5700] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:42:46.455246 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a97cd12b-0ce2-452b-b790-59346c43d679 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:46.455696 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a97cd12b-0ce2-452b-b790-59346c43d679 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:46.456471 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a97cd12b-0ce2-452b-b790-59346c43d679 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:46.456914 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-a97cd12b-0ce2-452b-b790-59346c43d679 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:46.684846 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-a97cd12b-0ce2-452b-b790-59346c43d679 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "POST /compute/v2.1/servers/eefb99f0-e5c6-47e0-8335-009e2b8c5700/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.240461 Jan 18 16:42:46.685514 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 582/1157] 10.222.0.82 () {60 vars in 1322 bytes} [Tue Jan 18 16:42:46 2022] POST /compute/v2.1/servers/eefb99f0-e5c6-47e0-8335-009e2b8c5700/os-volume_attachments => generated 194 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:42:53.182704 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-4a18de64-c692-492f-84aa-1d42bb88a349 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:42:53.183200 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-4a18de64-c692-492f-84aa-1d42bb88a349 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: eefb99f0-e5c6-47e0-8335-009e2b8c5700] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:42:53.189229 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4a18de64-c692-492f-84aa-1d42bb88a349 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:53.189933 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4a18de64-c692-492f-84aa-1d42bb88a349 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:53.190709 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4a18de64-c692-492f-84aa-1d42bb88a349 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:53.191144 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-4a18de64-c692-492f-84aa-1d42bb88a349 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:53.271408 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.objects.instance [None req-4a18de64-c692-492f-84aa-1d42bb88a349 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lazy-loading 'services' on Instance uuid eefb99f0-e5c6-47e0-8335-009e2b8c5700 {{(pid=116368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 18 16:42:53.339342 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-4a18de64-c692-492f-84aa-1d42bb88a349 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "DELETE /compute/v2.1/servers/eefb99f0-e5c6-47e0-8335-009e2b8c5700/os-volume_attachments/7c2c5ba3-458b-4e7d-9f86-e639fe6dc10c" status: 202 len: 0 microversion: 2.1 time: 0.160378 Jan 18 16:42:53.339972 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 576/1158] 10.222.0.82 () {58 vars in 1415 bytes} [Tue Jan 18 16:42:53 2022] DELETE /compute/v2.1/servers/eefb99f0-e5c6-47e0-8335-009e2b8c5700/os-volume_attachments/7c2c5ba3-458b-4e7d-9f86-e639fe6dc10c => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 18 16:42:53.349067 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-aa9a8d9b-00fc-468d-bddb-3f700b7ab942 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:42:53.350112 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-aa9a8d9b-00fc-468d-bddb-3f700b7ab942 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: eefb99f0-e5c6-47e0-8335-009e2b8c5700] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:42:53.356679 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-aa9a8d9b-00fc-468d-bddb-3f700b7ab942 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:53.357198 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-aa9a8d9b-00fc-468d-bddb-3f700b7ab942 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:53.358195 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-aa9a8d9b-00fc-468d-bddb-3f700b7ab942 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:53.358700 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-aa9a8d9b-00fc-468d-bddb-3f700b7ab942 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:53.388809 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-aa9a8d9b-00fc-468d-bddb-3f700b7ab942 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "GET /compute/v2.1/servers/eefb99f0-e5c6-47e0-8335-009e2b8c5700/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044307 Jan 18 16:42:53.389404 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 583/1159] 10.222.0.82 () {58 vars in 1301 bytes} [Tue Jan 18 16:42:53 2022] GET /compute/v2.1/servers/eefb99f0-e5c6-47e0-8335-009e2b8c5700/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:42:54.401864 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-3aaf94ea-7519-44eb-a2ae-56ad382999a2 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:42:54.402937 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-3aaf94ea-7519-44eb-a2ae-56ad382999a2 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: eefb99f0-e5c6-47e0-8335-009e2b8c5700] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:42:54.409528 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3aaf94ea-7519-44eb-a2ae-56ad382999a2 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:54.410022 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3aaf94ea-7519-44eb-a2ae-56ad382999a2 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:54.410801 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3aaf94ea-7519-44eb-a2ae-56ad382999a2 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:54.411233 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-3aaf94ea-7519-44eb-a2ae-56ad382999a2 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:54.440623 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-3aaf94ea-7519-44eb-a2ae-56ad382999a2 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "GET /compute/v2.1/servers/eefb99f0-e5c6-47e0-8335-009e2b8c5700/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043666 Jan 18 16:42:54.441224 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 577/1160] 10.222.0.82 () {58 vars in 1301 bytes} [Tue Jan 18 16:42:54 2022] GET /compute/v2.1/servers/eefb99f0-e5c6-47e0-8335-009e2b8c5700/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 18 16:42:55.622223 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-7cfe475d-615f-488b-8898-a7dcfca89e65 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:42:55.622701 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-7cfe475d-615f-488b-8898-a7dcfca89e65 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: eefb99f0-e5c6-47e0-8335-009e2b8c5700] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:42:55.628822 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7cfe475d-615f-488b-8898-a7dcfca89e65 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:55.629298 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7cfe475d-615f-488b-8898-a7dcfca89e65 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:55.630234 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7cfe475d-615f-488b-8898-a7dcfca89e65 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:55.630664 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-7cfe475d-615f-488b-8898-a7dcfca89e65 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:55.656737 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-7cfe475d-615f-488b-8898-a7dcfca89e65 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: eefb99f0-e5c6-47e0-8335-009e2b8c5700] Going to try to terminate instance {{(pid=116367) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 18 16:42:55.730320 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-7cfe475d-615f-488b-8898-a7dcfca89e65 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "DELETE /compute/v2.1/servers/eefb99f0-e5c6-47e0-8335-009e2b8c5700" status: 204 len: 0 microversion: 2.1 time: 0.111320 Jan 18 16:42:55.730955 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 584/1161] 10.222.0.82 () {58 vars in 1238 bytes} [Tue Jan 18 16:42:55 2022] DELETE /compute/v2.1/servers/eefb99f0-e5c6-47e0-8335-009e2b8c5700 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 18 16:42:55.738991 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-08ccf227-b625-421e-abed-e145a8c7ffe1 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:42:55.739604 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-08ccf227-b625-421e-abed-e145a8c7ffe1 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: eefb99f0-e5c6-47e0-8335-009e2b8c5700] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:42:55.745874 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-08ccf227-b625-421e-abed-e145a8c7ffe1 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:55.746322 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-08ccf227-b625-421e-abed-e145a8c7ffe1 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:55.747104 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-08ccf227-b625-421e-abed-e145a8c7ffe1 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:55.747542 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-08ccf227-b625-421e-abed-e145a8c7ffe1 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:55.879224 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-08ccf227-b625-421e-abed-e145a8c7ffe1 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f30f1ddb7249b5a7551464a7ab48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cee5b17bce4fc186700e306378f767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:42:55.887113 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-08ccf227-b625-421e-abed-e145a8c7ffe1 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "GET /compute/v2.1/servers/eefb99f0-e5c6-47e0-8335-009e2b8c5700" status: 200 len: 1513 microversion: 2.1 time: 0.151758 Jan 18 16:42:55.887668 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 578/1162] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:42:55 2022] GET /compute/v2.1/servers/eefb99f0-e5c6-47e0-8335-009e2b8c5700 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:42:56.904492 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-6f83dcc3-6d1c-4816-bddf-2e505e249735 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:42:56.905224 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-6f83dcc3-6d1c-4816-bddf-2e505e249735 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: eefb99f0-e5c6-47e0-8335-009e2b8c5700] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:42:56.911384 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6f83dcc3-6d1c-4816-bddf-2e505e249735 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:56.911832 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6f83dcc3-6d1c-4816-bddf-2e505e249735 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:56.912603 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6f83dcc3-6d1c-4816-bddf-2e505e249735 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:56.913662 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-6f83dcc3-6d1c-4816-bddf-2e505e249735 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:57.042956 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-6f83dcc3-6d1c-4816-bddf-2e505e249735 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f30f1ddb7249b5a7551464a7ab48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cee5b17bce4fc186700e306378f767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:42:57.050288 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-6f83dcc3-6d1c-4816-bddf-2e505e249735 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "GET /compute/v2.1/servers/eefb99f0-e5c6-47e0-8335-009e2b8c5700" status: 200 len: 1513 microversion: 2.1 time: 0.149922 Jan 18 16:42:57.050854 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 585/1163] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:42:56 2022] GET /compute/v2.1/servers/eefb99f0-e5c6-47e0-8335-009e2b8c5700 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:42:57.967132 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [req-4e8c2a23-e1fe-4159-8f01-9d51d11f6741 req-3912b444-1465-4ba7-8f15-336a5b0a7604 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eefb99f0-e5c6-47e0-8335-009e2b8c5700", "name": "network-vif-deleted", "tag": "071e0062-44e2-4ab1-b50f-0e26dabec496"}]} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:42:57.968658 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:42:57.968658 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: warnings.warn(msg) Jan 18 16:42:57.976392 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-4e8c2a23-e1fe-4159-8f01-9d51d11f6741 req-3912b444-1465-4ba7-8f15-336a5b0a7604 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:57.976845 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-4e8c2a23-e1fe-4159-8f01-9d51d11f6741 req-3912b444-1465-4ba7-8f15-336a5b0a7604 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:57.990019 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.compute.server_external_events [req-4e8c2a23-e1fe-4159-8f01-9d51d11f6741 req-3912b444-1465-4ba7-8f15-336a5b0a7604 service nova] Creating event network-vif-deleted:071e0062-44e2-4ab1-b50f-0e26dabec496 for instance eefb99f0-e5c6-47e0-8335-009e2b8c5700 on hv-cinder-78836 Jan 18 16:42:57.995439 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [req-4e8c2a23-e1fe-4159-8f01-9d51d11f6741 req-3912b444-1465-4ba7-8f15-336a5b0a7604 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031816 Jan 18 16:42:57.997080 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 579/1164] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:42:58.067423 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-58e9de87-d9a8-4a39-ab5b-b7e6a71a3f9e tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:42:58.068157 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-58e9de87-d9a8-4a39-ab5b-b7e6a71a3f9e tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: eefb99f0-e5c6-47e0-8335-009e2b8c5700] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:42:58.075439 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-58e9de87-d9a8-4a39-ab5b-b7e6a71a3f9e tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:58.075881 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-58e9de87-d9a8-4a39-ab5b-b7e6a71a3f9e tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:58.076697 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-58e9de87-d9a8-4a39-ab5b-b7e6a71a3f9e tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:58.077155 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-58e9de87-d9a8-4a39-ab5b-b7e6a71a3f9e tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:58.108622 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-58e9de87-d9a8-4a39-ab5b-b7e6a71a3f9e tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:58.109103 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-58e9de87-d9a8-4a39-ab5b-b7e6a71a3f9e tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:58.109558 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.objects.instance [None req-58e9de87-d9a8-4a39-ab5b-b7e6a71a3f9e tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lazy-loading 'fault' on Instance uuid eefb99f0-e5c6-47e0-8335-009e2b8c5700 {{(pid=116367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 18 16:42:58.149448 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-58e9de87-d9a8-4a39-ab5b-b7e6a71a3f9e tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f30f1ddb7249b5a7551464a7ab48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cee5b17bce4fc186700e306378f767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:42:58.156619 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-58e9de87-d9a8-4a39-ab5b-b7e6a71a3f9e tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "GET /compute/v2.1/servers/eefb99f0-e5c6-47e0-8335-009e2b8c5700" status: 200 len: 1308 microversion: 2.1 time: 0.093407 Jan 18 16:42:58.157217 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 586/1165] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:42:58 2022] GET /compute/v2.1/servers/eefb99f0-e5c6-47e0-8335-009e2b8c5700 => generated 1308 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:42:59.174529 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-5e30f2f8-f53f-4283-b164-3cf9c537f287 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:42:59.175255 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-5e30f2f8-f53f-4283-b164-3cf9c537f287 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: eefb99f0-e5c6-47e0-8335-009e2b8c5700] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:42:59.181760 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-5e30f2f8-f53f-4283-b164-3cf9c537f287 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:59.182205 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-5e30f2f8-f53f-4283-b164-3cf9c537f287 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:59.182981 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-5e30f2f8-f53f-4283-b164-3cf9c537f287 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:42:59.183416 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-5e30f2f8-f53f-4283-b164-3cf9c537f287 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:42:59.197298 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.wsgi [None req-5e30f2f8-f53f-4283-b164-3cf9c537f287 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] HTTP exception thrown: Instance eefb99f0-e5c6-47e0-8335-009e2b8c5700 could not be found. Jan 18 16:42:59.197885 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-5e30f2f8-f53f-4283-b164-3cf9c537f287 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Returning 404 to user: Instance eefb99f0-e5c6-47e0-8335-009e2b8c5700 could not be found. {{(pid=116368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 16:42:59.198691 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-5e30f2f8-f53f-4283-b164-3cf9c537f287 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "GET /compute/v2.1/servers/eefb99f0-e5c6-47e0-8335-009e2b8c5700" status: 404 len: 111 microversion: 2.1 time: 0.028632 Jan 18 16:42:59.199225 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 580/1166] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:42:59 2022] GET /compute/v2.1/servers/eefb99f0-e5c6-47e0-8335-009e2b8c5700 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 16:43:00.325967 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-de60c051-dcf8-497f-8fef-40548b737274 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:43:00.326709 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-de60c051-dcf8-497f-8fef-40548b737274 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: eb69959b-1cc0-4168-aee6-0886926fba95] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:43:00.333566 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-de60c051-dcf8-497f-8fef-40548b737274 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:43:00.334056 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-de60c051-dcf8-497f-8fef-40548b737274 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:43:00.334942 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-de60c051-dcf8-497f-8fef-40548b737274 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:43:00.335414 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-de60c051-dcf8-497f-8fef-40548b737274 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:43:00.361874 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-de60c051-dcf8-497f-8fef-40548b737274 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: eb69959b-1cc0-4168-aee6-0886926fba95] Going to try to terminate instance {{(pid=116367) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 18 16:43:00.436463 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-de60c051-dcf8-497f-8fef-40548b737274 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "DELETE /compute/v2.1/servers/eb69959b-1cc0-4168-aee6-0886926fba95" status: 204 len: 0 microversion: 2.1 time: 0.114163 Jan 18 16:43:00.437209 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 587/1167] 10.222.0.82 () {58 vars in 1238 bytes} [Tue Jan 18 16:43:00 2022] DELETE /compute/v2.1/servers/eb69959b-1cc0-4168-aee6-0886926fba95 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 18 16:43:00.445762 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-fa1482a3-a1a5-468a-9029-2428cabe6b89 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:43:00.446446 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-fa1482a3-a1a5-468a-9029-2428cabe6b89 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: eb69959b-1cc0-4168-aee6-0886926fba95] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:43:00.453119 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-fa1482a3-a1a5-468a-9029-2428cabe6b89 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:43:00.453556 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-fa1482a3-a1a5-468a-9029-2428cabe6b89 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:43:00.454337 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-fa1482a3-a1a5-468a-9029-2428cabe6b89 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:43:00.454785 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-fa1482a3-a1a5-468a-9029-2428cabe6b89 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:43:00.585276 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-fa1482a3-a1a5-468a-9029-2428cabe6b89 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f30f1ddb7249b5a7551464a7ab48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cee5b17bce4fc186700e306378f767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:43:00.593621 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-fa1482a3-a1a5-468a-9029-2428cabe6b89 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "GET /compute/v2.1/servers/eb69959b-1cc0-4168-aee6-0886926fba95" status: 200 len: 1513 microversion: 2.1 time: 0.151875 Jan 18 16:43:00.594176 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 581/1168] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:43:00 2022] GET /compute/v2.1/servers/eb69959b-1cc0-4168-aee6-0886926fba95 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:43:01.611968 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-0723ffe0-0176-4d43-b302-00d5cfc190f8 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:43:01.612642 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-0723ffe0-0176-4d43-b302-00d5cfc190f8 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: eb69959b-1cc0-4168-aee6-0886926fba95] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:43:01.619195 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0723ffe0-0176-4d43-b302-00d5cfc190f8 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:43:01.619640 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0723ffe0-0176-4d43-b302-00d5cfc190f8 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:43:01.620414 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0723ffe0-0176-4d43-b302-00d5cfc190f8 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:43:01.620849 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0723ffe0-0176-4d43-b302-00d5cfc190f8 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:43:01.759086 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-0723ffe0-0176-4d43-b302-00d5cfc190f8 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f30f1ddb7249b5a7551464a7ab48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cee5b17bce4fc186700e306378f767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:43:01.766422 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-0723ffe0-0176-4d43-b302-00d5cfc190f8 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "GET /compute/v2.1/servers/eb69959b-1cc0-4168-aee6-0886926fba95" status: 200 len: 1513 microversion: 2.1 time: 0.158609 Jan 18 16:43:01.766990 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 588/1169] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:43:01 2022] GET /compute/v2.1/servers/eb69959b-1cc0-4168-aee6-0886926fba95 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:43:02.509334 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [req-d9bea880-050f-4c53-b5fc-63baaf90670d req-7a3b5cb1-b34e-488c-a3d0-1193a4e0758f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb69959b-1cc0-4168-aee6-0886926fba95", "name": "network-vif-deleted", "tag": "56024420-ad6b-4854-aa0f-aa6969a73f3b"}]} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:43:02.510983 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:43:02.510983 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: warnings.warn(msg) Jan 18 16:43:02.519065 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-d9bea880-050f-4c53-b5fc-63baaf90670d req-7a3b5cb1-b34e-488c-a3d0-1193a4e0758f service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:43:02.519502 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-d9bea880-050f-4c53-b5fc-63baaf90670d req-7a3b5cb1-b34e-488c-a3d0-1193a4e0758f service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:43:02.531534 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.compute.server_external_events [req-d9bea880-050f-4c53-b5fc-63baaf90670d req-7a3b5cb1-b34e-488c-a3d0-1193a4e0758f service nova] Creating event network-vif-deleted:56024420-ad6b-4854-aa0f-aa6969a73f3b for instance eb69959b-1cc0-4168-aee6-0886926fba95 on hv-cinder-78836 Jan 18 16:43:02.536843 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [req-d9bea880-050f-4c53-b5fc-63baaf90670d req-7a3b5cb1-b34e-488c-a3d0-1193a4e0758f service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031024 Jan 18 16:43:02.537478 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 582/1170] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:43:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:43:02.783321 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-50c5cb04-d073-4f1e-ae67-ebb67c6ef753 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:43:02.783937 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-50c5cb04-d073-4f1e-ae67-ebb67c6ef753 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: eb69959b-1cc0-4168-aee6-0886926fba95] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:43:02.791306 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-50c5cb04-d073-4f1e-ae67-ebb67c6ef753 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:43:02.791752 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-50c5cb04-d073-4f1e-ae67-ebb67c6ef753 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:43:02.793559 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-50c5cb04-d073-4f1e-ae67-ebb67c6ef753 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:43:02.794027 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-50c5cb04-d073-4f1e-ae67-ebb67c6ef753 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:43:02.824493 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-50c5cb04-d073-4f1e-ae67-ebb67c6ef753 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:43:02.824986 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-50c5cb04-d073-4f1e-ae67-ebb67c6ef753 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:43:02.825443 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.objects.instance [None req-50c5cb04-d073-4f1e-ae67-ebb67c6ef753 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lazy-loading 'fault' on Instance uuid eb69959b-1cc0-4168-aee6-0886926fba95 {{(pid=116367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 18 16:43:02.865165 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-50c5cb04-d073-4f1e-ae67-ebb67c6ef753 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f30f1ddb7249b5a7551464a7ab48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cee5b17bce4fc186700e306378f767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:43:02.873260 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-50c5cb04-d073-4f1e-ae67-ebb67c6ef753 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "GET /compute/v2.1/servers/eb69959b-1cc0-4168-aee6-0886926fba95" status: 200 len: 1308 microversion: 2.1 time: 0.093550 Jan 18 16:43:02.873830 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 589/1171] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:43:02 2022] GET /compute/v2.1/servers/eb69959b-1cc0-4168-aee6-0886926fba95 => generated 1308 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:43:03.891337 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-f572a70c-89e9-4640-bd80-24e08059854c tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:43:03.892038 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-f572a70c-89e9-4640-bd80-24e08059854c tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: eb69959b-1cc0-4168-aee6-0886926fba95] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:43:03.898205 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f572a70c-89e9-4640-bd80-24e08059854c tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:43:03.898665 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f572a70c-89e9-4640-bd80-24e08059854c tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:43:03.899442 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f572a70c-89e9-4640-bd80-24e08059854c tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:43:03.899880 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-f572a70c-89e9-4640-bd80-24e08059854c tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:43:03.913180 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.wsgi [None req-f572a70c-89e9-4640-bd80-24e08059854c tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] HTTP exception thrown: Instance eb69959b-1cc0-4168-aee6-0886926fba95 could not be found. Jan 18 16:43:03.914307 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-f572a70c-89e9-4640-bd80-24e08059854c tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Returning 404 to user: Instance eb69959b-1cc0-4168-aee6-0886926fba95 could not be found. {{(pid=116368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 16:43:03.915110 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-f572a70c-89e9-4640-bd80-24e08059854c tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "GET /compute/v2.1/servers/eb69959b-1cc0-4168-aee6-0886926fba95" status: 404 len: 111 microversion: 2.1 time: 0.028622 Jan 18 16:43:03.915631 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 583/1172] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:43:03 2022] GET /compute/v2.1/servers/eb69959b-1cc0-4168-aee6-0886926fba95 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 16:43:03.923316 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-fcdace61-1980-468c-985a-133a79ea4b49 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:43:03.923856 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-fcdace61-1980-468c-985a-133a79ea4b49 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: 6622da12-a0e7-4ddc-b0eb-cdc5098937fb] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:43:03.930700 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-fcdace61-1980-468c-985a-133a79ea4b49 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:43:03.931144 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-fcdace61-1980-468c-985a-133a79ea4b49 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:43:03.931924 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-fcdace61-1980-468c-985a-133a79ea4b49 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:43:03.932364 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-fcdace61-1980-468c-985a-133a79ea4b49 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:43:03.956137 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-fcdace61-1980-468c-985a-133a79ea4b49 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: 6622da12-a0e7-4ddc-b0eb-cdc5098937fb] Going to try to terminate instance {{(pid=116367) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 18 16:43:04.030808 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-fcdace61-1980-468c-985a-133a79ea4b49 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "DELETE /compute/v2.1/servers/6622da12-a0e7-4ddc-b0eb-cdc5098937fb" status: 204 len: 0 microversion: 2.1 time: 0.110688 Jan 18 16:43:04.031596 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 590/1173] 10.222.0.82 () {58 vars in 1238 bytes} [Tue Jan 18 16:43:03 2022] DELETE /compute/v2.1/servers/6622da12-a0e7-4ddc-b0eb-cdc5098937fb => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 18 16:43:04.040977 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-570ea688-e7fb-4154-a437-a1afac603bb5 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:43:04.041634 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-570ea688-e7fb-4154-a437-a1afac603bb5 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: 6622da12-a0e7-4ddc-b0eb-cdc5098937fb] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:43:04.047479 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-570ea688-e7fb-4154-a437-a1afac603bb5 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:43:04.047930 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-570ea688-e7fb-4154-a437-a1afac603bb5 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:43:04.048720 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-570ea688-e7fb-4154-a437-a1afac603bb5 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:43:04.049188 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-570ea688-e7fb-4154-a437-a1afac603bb5 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:43:04.183292 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-570ea688-e7fb-4154-a437-a1afac603bb5 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f30f1ddb7249b5a7551464a7ab48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cee5b17bce4fc186700e306378f767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:43:04.190835 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-570ea688-e7fb-4154-a437-a1afac603bb5 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "GET /compute/v2.1/servers/6622da12-a0e7-4ddc-b0eb-cdc5098937fb" status: 200 len: 1513 microversion: 2.1 time: 0.154613 Jan 18 16:43:04.191448 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 584/1174] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:43:04 2022] GET /compute/v2.1/servers/6622da12-a0e7-4ddc-b0eb-cdc5098937fb => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:43:05.207783 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-0c8e9a71-ac94-4eb9-a215-faf3110d2079 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:43:05.208463 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-0c8e9a71-ac94-4eb9-a215-faf3110d2079 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: 6622da12-a0e7-4ddc-b0eb-cdc5098937fb] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:43:05.214624 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0c8e9a71-ac94-4eb9-a215-faf3110d2079 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:43:05.215062 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0c8e9a71-ac94-4eb9-a215-faf3110d2079 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:43:05.215824 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0c8e9a71-ac94-4eb9-a215-faf3110d2079 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:43:05.216251 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-0c8e9a71-ac94-4eb9-a215-faf3110d2079 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:43:05.344532 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-0c8e9a71-ac94-4eb9-a215-faf3110d2079 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f30f1ddb7249b5a7551464a7ab48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cee5b17bce4fc186700e306378f767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:43:05.352575 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-0c8e9a71-ac94-4eb9-a215-faf3110d2079 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "GET /compute/v2.1/servers/6622da12-a0e7-4ddc-b0eb-cdc5098937fb" status: 200 len: 1513 microversion: 2.1 time: 0.148771 Jan 18 16:43:05.353170 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 591/1175] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:43:05 2022] GET /compute/v2.1/servers/6622da12-a0e7-4ddc-b0eb-cdc5098937fb => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:43:05.874950 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [req-4fda3ef6-8246-48cf-9549-a468e20f30f0 req-cd591b63-487f-45b4-b7de-2fe81c7d0fe3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6622da12-a0e7-4ddc-b0eb-cdc5098937fb", "name": "network-vif-deleted", "tag": "4e43b3a1-3e71-4876-b998-a471d3058d1f"}]} {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:43:05.876939 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:43:05.876939 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: warnings.warn(msg) Jan 18 16:43:05.886448 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-4fda3ef6-8246-48cf-9549-a468e20f30f0 req-cd591b63-487f-45b4-b7de-2fe81c7d0fe3 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:43:05.887198 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [req-4fda3ef6-8246-48cf-9549-a468e20f30f0 req-cd591b63-487f-45b4-b7de-2fe81c7d0fe3 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:43:05.903997 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.compute.server_external_events [req-4fda3ef6-8246-48cf-9549-a468e20f30f0 req-cd591b63-487f-45b4-b7de-2fe81c7d0fe3 service nova] Creating event network-vif-deleted:4e43b3a1-3e71-4876-b998-a471d3058d1f for instance 6622da12-a0e7-4ddc-b0eb-cdc5098937fb on hv-cinder-78836 Jan 18 16:43:05.909245 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [req-4fda3ef6-8246-48cf-9549-a468e20f30f0 req-cd591b63-487f-45b4-b7de-2fe81c7d0fe3 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041421 Jan 18 16:43:05.910223 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 585/1176] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:43:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:43:06.369962 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-9a1bf71c-1af6-4145-90d7-2e602a4f8a47 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:43:06.370619 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-9a1bf71c-1af6-4145-90d7-2e602a4f8a47 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: 6622da12-a0e7-4ddc-b0eb-cdc5098937fb] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:43:06.377227 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-9a1bf71c-1af6-4145-90d7-2e602a4f8a47 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:43:06.377683 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-9a1bf71c-1af6-4145-90d7-2e602a4f8a47 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:43:06.378439 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-9a1bf71c-1af6-4145-90d7-2e602a4f8a47 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:43:06.378897 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-9a1bf71c-1af6-4145-90d7-2e602a4f8a47 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:43:06.392507 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.wsgi [None req-9a1bf71c-1af6-4145-90d7-2e602a4f8a47 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] HTTP exception thrown: Instance 6622da12-a0e7-4ddc-b0eb-cdc5098937fb could not be found. Jan 18 16:43:06.393123 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-9a1bf71c-1af6-4145-90d7-2e602a4f8a47 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Returning 404 to user: Instance 6622da12-a0e7-4ddc-b0eb-cdc5098937fb could not be found. {{(pid=116367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 16:43:06.393937 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-9a1bf71c-1af6-4145-90d7-2e602a4f8a47 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "GET /compute/v2.1/servers/6622da12-a0e7-4ddc-b0eb-cdc5098937fb" status: 404 len: 111 microversion: 2.1 time: 0.028639 Jan 18 16:43:06.394460 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 592/1177] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:43:06 2022] GET /compute/v2.1/servers/6622da12-a0e7-4ddc-b0eb-cdc5098937fb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 16:43:07.522563 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-b061e93b-6ef2-4f49-a6fa-931d42ab39b4 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:43:07.523494 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-b061e93b-6ef2-4f49-a6fa-931d42ab39b4 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: c9d430db-b5ab-4c0e-add0-a4abe3607e9c] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:43:07.529832 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-b061e93b-6ef2-4f49-a6fa-931d42ab39b4 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:43:07.530272 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-b061e93b-6ef2-4f49-a6fa-931d42ab39b4 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:43:07.531038 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-b061e93b-6ef2-4f49-a6fa-931d42ab39b4 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:43:07.531464 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-b061e93b-6ef2-4f49-a6fa-931d42ab39b4 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:43:07.556432 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-b061e93b-6ef2-4f49-a6fa-931d42ab39b4 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: c9d430db-b5ab-4c0e-add0-a4abe3607e9c] Going to try to terminate instance {{(pid=116368) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 18 16:43:07.627419 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-b061e93b-6ef2-4f49-a6fa-931d42ab39b4 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "DELETE /compute/v2.1/servers/c9d430db-b5ab-4c0e-add0-a4abe3607e9c" status: 204 len: 0 microversion: 2.1 time: 0.108536 Jan 18 16:43:07.628005 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 586/1178] 10.222.0.82 () {58 vars in 1238 bytes} [Tue Jan 18 16:43:07 2022] DELETE /compute/v2.1/servers/c9d430db-b5ab-4c0e-add0-a4abe3607e9c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 18 16:43:07.636588 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-eef161c1-8374-46c2-8925-207f6fc7c6e4 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:43:07.637232 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-eef161c1-8374-46c2-8925-207f6fc7c6e4 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: c9d430db-b5ab-4c0e-add0-a4abe3607e9c] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:43:07.643196 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-eef161c1-8374-46c2-8925-207f6fc7c6e4 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:43:07.643646 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-eef161c1-8374-46c2-8925-207f6fc7c6e4 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:43:07.644417 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-eef161c1-8374-46c2-8925-207f6fc7c6e4 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:43:07.644858 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-eef161c1-8374-46c2-8925-207f6fc7c6e4 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:43:07.774205 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.policy [None req-eef161c1-8374-46c2-8925-207f6fc7c6e4 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f30f1ddb7249b5a7551464a7ab48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cee5b17bce4fc186700e306378f767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:43:07.781526 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-eef161c1-8374-46c2-8925-207f6fc7c6e4 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "GET /compute/v2.1/servers/c9d430db-b5ab-4c0e-add0-a4abe3607e9c" status: 200 len: 1513 microversion: 2.1 time: 0.149265 Jan 18 16:43:07.782088 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 593/1179] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:43:07 2022] GET /compute/v2.1/servers/c9d430db-b5ab-4c0e-add0-a4abe3607e9c => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:43:08.799477 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-1a06af1d-9266-485c-8802-816a5d995e7c tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:43:08.800166 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-1a06af1d-9266-485c-8802-816a5d995e7c tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: c9d430db-b5ab-4c0e-add0-a4abe3607e9c] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:43:08.807481 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1a06af1d-9266-485c-8802-816a5d995e7c tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:43:08.807925 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1a06af1d-9266-485c-8802-816a5d995e7c tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:43:08.808694 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1a06af1d-9266-485c-8802-816a5d995e7c tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:43:08.809157 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-1a06af1d-9266-485c-8802-816a5d995e7c tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:43:08.943240 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-1a06af1d-9266-485c-8802-816a5d995e7c tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f30f1ddb7249b5a7551464a7ab48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cee5b17bce4fc186700e306378f767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:43:08.950585 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-1a06af1d-9266-485c-8802-816a5d995e7c tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "GET /compute/v2.1/servers/c9d430db-b5ab-4c0e-add0-a4abe3607e9c" status: 200 len: 1513 microversion: 2.1 time: 0.155097 Jan 18 16:43:08.951171 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 587/1180] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:43:08 2022] GET /compute/v2.1/servers/c9d430db-b5ab-4c0e-add0-a4abe3607e9c => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 16:43:09.593258 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [req-8117677c-fd93-4a5b-a519-26b5d6d8e0b0 req-8d763229-00a2-417c-9df2-7b114d4f66c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9d430db-b5ab-4c0e-add0-a4abe3607e9c", "name": "network-vif-deleted", "tag": "4ab2fb4e-fd27-4ffa-89a9-7b5cd49ceaf3"}]} {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 16:43:09.595424 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 16:43:09.595424 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: warnings.warn(msg) Jan 18 16:43:09.608648 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-8117677c-fd93-4a5b-a519-26b5d6d8e0b0 req-8d763229-00a2-417c-9df2-7b114d4f66c1 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:43:09.609296 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [req-8117677c-fd93-4a5b-a519-26b5d6d8e0b0 req-8d763229-00a2-417c-9df2-7b114d4f66c1 service nova] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:43:09.624625 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.compute.server_external_events [req-8117677c-fd93-4a5b-a519-26b5d6d8e0b0 req-8d763229-00a2-417c-9df2-7b114d4f66c1 service nova] Creating event network-vif-deleted:4ab2fb4e-fd27-4ffa-89a9-7b5cd49ceaf3 for instance c9d430db-b5ab-4c0e-add0-a4abe3607e9c on hv-cinder-78836 Jan 18 16:43:09.629444 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [req-8117677c-fd93-4a5b-a519-26b5d6d8e0b0 req-8d763229-00a2-417c-9df2-7b114d4f66c1 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040278 Jan 18 16:43:09.630021 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 594/1181] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Jan 18 16:43:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 16:43:09.967512 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.api.openstack.wsgi [None req-40e9bba0-a8f9-40ee-bb4b-28be8494c6b8 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:43:09.968162 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.compute.api [None req-40e9bba0-a8f9-40ee-bb4b-28be8494c6b8 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: c9d430db-b5ab-4c0e-add0-a4abe3607e9c] Fetching instance by UUID {{(pid=116368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:43:09.974514 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-40e9bba0-a8f9-40ee-bb4b-28be8494c6b8 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:43:09.974979 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-40e9bba0-a8f9-40ee-bb4b-28be8494c6b8 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:43:09.976336 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-40e9bba0-a8f9-40ee-bb4b-28be8494c6b8 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:43:09.976800 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-40e9bba0-a8f9-40ee-bb4b-28be8494c6b8 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:43:10.008090 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-40e9bba0-a8f9-40ee-bb4b-28be8494c6b8 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:43:10.008531 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG oslo_concurrency.lockutils [None req-40e9bba0-a8f9-40ee-bb4b-28be8494c6b8 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:43:10.009009 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.objects.instance [None req-40e9bba0-a8f9-40ee-bb4b-28be8494c6b8 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lazy-loading 'fault' on Instance uuid c9d430db-b5ab-4c0e-add0-a4abe3607e9c {{(pid=116368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 18 16:43:10.050213 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: DEBUG nova.policy [None req-40e9bba0-a8f9-40ee-bb4b-28be8494c6b8 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f30f1ddb7249b5a7551464a7ab48fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cee5b17bce4fc186700e306378f767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 16:43:10.058599 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO nova.api.openstack.requestlog [None req-40e9bba0-a8f9-40ee-bb4b-28be8494c6b8 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "GET /compute/v2.1/servers/c9d430db-b5ab-4c0e-add0-a4abe3607e9c" status: 200 len: 1307 microversion: 2.1 time: 0.094773 Jan 18 16:43:10.059178 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: [pid: 116368|app: 0|req: 588/1182] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:43:09 2022] GET /compute/v2.1/servers/c9d430db-b5ab-4c0e-add0-a4abe3607e9c => generated 1307 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 16:43:11.077433 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-f8893840-a9b3-46f9-aec3-63b39d7c8b40 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Calling method '>' {{(pid=116367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 16:43:11.078126 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.compute.api [None req-f8893840-a9b3-46f9-aec3-63b39d7c8b40 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] [instance: c9d430db-b5ab-4c0e-add0-a4abe3607e9c] Fetching instance by UUID {{(pid=116367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 16:43:11.084241 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-f8893840-a9b3-46f9-aec3-63b39d7c8b40 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:43:11.084688 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-f8893840-a9b3-46f9-aec3-63b39d7c8b40 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:43:11.086072 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-f8893840-a9b3-46f9-aec3-63b39d7c8b40 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 16:43:11.086509 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG oslo_concurrency.lockutils [None req-f8893840-a9b3-46f9-aec3-63b39d7c8b40 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Lock "893648b7-9c61-4bb4-8054-545f5288e2ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 16:43:11.099193 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.wsgi [None req-f8893840-a9b3-46f9-aec3-63b39d7c8b40 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] HTTP exception thrown: Instance c9d430db-b5ab-4c0e-add0-a4abe3607e9c could not be found. Jan 18 16:43:11.099776 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: DEBUG nova.api.openstack.wsgi [None req-f8893840-a9b3-46f9-aec3-63b39d7c8b40 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] Returning 404 to user: Instance c9d430db-b5ab-4c0e-add0-a4abe3607e9c could not be found. {{(pid=116367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 16:43:11.100578 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO nova.api.openstack.requestlog [None req-f8893840-a9b3-46f9-aec3-63b39d7c8b40 tempest-AttachVolumeNegativeTest-89305355 tempest-AttachVolumeNegativeTest-89305355-project] 10.222.0.82 "GET /compute/v2.1/servers/c9d430db-b5ab-4c0e-add0-a4abe3607e9c" status: 404 len: 111 microversion: 2.1 time: 0.027672 Jan 18 16:43:11.101584 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: [pid: 116367|app: 0|req: 595/1183] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Jan 18 16:43:11 2022] GET /compute/v2.1/servers/c9d430db-b5ab-4c0e-add0-a4abe3607e9c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 16:43:25.764909 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 18 16:43:25.765590 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: Tue Jan 18 16:43:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 18 16:44:56.635570 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 18 16:44:56.636244 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: Tue Jan 18 16:44:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 18 16:45:12.288801 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 18 16:45:12.289634 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: Tue Jan 18 16:45:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 18 16:45:13.126531 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 18 16:45:13.127087 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: Tue Jan 18 16:45:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 18 16:45:22.374011 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 18 16:45:22.374626 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: Tue Jan 18 16:45:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 18 16:46:38.830040 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 18 16:46:38.830777 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: Tue Jan 18 16:46:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 18 16:46:45.773443 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 18 16:46:45.774316 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: Tue Jan 18 16:46:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 18 16:48:16.643380 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 18 16:48:16.643994 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: Tue Jan 18 16:48:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 18 16:48:32.297786 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 18 16:48:32.298312 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: Tue Jan 18 16:48:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 18 16:48:33.136069 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 18 16:48:33.136540 dv-cinder-788368-3-iscsi devstack@n-api.service[116368]: Tue Jan 18 16:48:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 18 16:48:42.381930 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 18 16:48:42.382534 dv-cinder-788368-3-iscsi devstack@n-api.service[116367]: Tue Jan 18 16:48:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!